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INTRODUCTION 


This technical report completes one facet of Project ASTRO. In this report 
we show that signals encoded in a della modulator, format can undergo arithmetic 
processing without first being' transformed into a PCM format. In addition, we 
show that PCM and DM signals can be converted to the other format with less than 
0.5 dB degradation. 

Since a signal can be encoded into a DM format using half the number of 
binary digits required for PCM conversion, the results presented here indicate 
a way of significantly reducing the memory requirements of a data base. The next 
facet of this study will be to actually encode the data into a DM format store the 
bits in the (DM) data base and use that reduced data in the DBMS. 
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ABSTRACT 

ARITHMETIC PROCESSING AND DIGITAL CONVERSION 

OF 

ADAPTIVE DELTA MODULATION ENCODED SIGNALS' 

by 

Joseph L. LoCicero 

Advisor: Professor Donald L. Schilling 

This thesis can be divided into three distinct parts : 
direct arithmetic processing of adaptive delta modulation 
(ADM) encoded signals, conversion from ADM encoded signals 
to pulse code modulation (PCM) encoded signals~and conver- 
sion from PCM to ADM encoded signals. In the first part, 
it is shown that signals which are ADM encoded can be arith- 
metically processed directly, without first decoding. Oper- 
ating on the DM bit stream, and employing only standard 
digital hardware, the sum, difference and product can be ob- 
tained in PCM and ADM format. 

These arithmetic processing systems are analyzed and 
simulated on a digital computer. Employing a four- term, 
non-recursive, averaging filter after the processors, we 
show that, for constant inputs, the signal-to-noise ratio 
(SNR) of the DM device is exactly the same as that of their 
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PCM counterparts. SNR curves are obtained for these proces- 
sors when the inputs are single 'frequency tones and their 
performance is compared to similar PCM systems. At high bit 
rates, the performance of the DM adder is comparable to that 
of an equivalent, companded PCM system. At moderate and 
low bit rates , the SNR of the DM adder is at least 4 dB 
better than that of the PCM device. The DM multiplier, at 
any bit rate, has a SNR which is at least 5-10 dB higher 
than the SNR of a companded PCM system. 

The conversion from ADM to PCM encoded signals essen- 
tially deals with the changing from a high "information" 
rate (ADM) to a lower one (PCM) . The "information" rate is 
the frequency at which estimates of the encoded signal are 
available. This problem is solved by using a digital fil- 
ter, which operates on the ADM step sizes and which is de- 
signed with ideal low pass filter characteristics, and then 
utilizing a low (PCM) frequency sampling gate. Since the 
ADM estimate, x(k), is a wideband signal, even if the input 
is bandlimited, we must eliminate the high frequency com- 
ponents before sampling at the PCM rate or else suffer the 
disastrous effect of aliasing. We show the effect of the 
digital filter structure on x(k) by recasting the system into 
a cascade arrangement and evaluating, in the frequency domain, 
the transfer function relating x(k) to the improved ADM 
estimate. 

The ADM to PCM conversion system, with the non-recursive 
digital filter structure, is restricted to standard digital 
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hardware and its operation is evaluated via computer simula- 
tion. The performance of this converter is compared to the' 
performance of other systems which will produce the same net 
result. 'The simplest system achieves ADM to PCM conversion 
by sampling x(k) at the PCM rate. A family of performance 
curves, obtained with a sinusoidal input, shows that there 
is an 8-10 dB improvement in SNR, over the simple system, 
when the non-recursive digital filter structure is employed 
in the ADM to PCM converter. We find that the SNR of the 
optimal converter, which uses ideal analog demodulation of 
x(k) before PCM sampling, is only 1-2 dB better than the SNR 
of the converter with the non -recursive digital filter 
structure . 

When converting from PCM to ADM encoded signals, i.e,, 
changing from a low to a high "information" rate, we must 
estimate the signal excursion at discrete points- between the 
PCM samples and fit these values to a path through an "ADM 
signal estimate tree." A number of techniques, both depen- 
dent on the input signal statistics and independent of them, 
are developed to perform this conversion. A detailed statis- 
tical analysis is undertaken for one particular system which 
employs a very simple, all-digital method of converting from 
PCM to ADM format. This converter uses samples of a linear 
interpolation between PCM points as the input to an ADM. 

This system is simulated on a digital computer and SNR curves 
are generated to determine its performance. We find that for 
a low frequency tone, the performance of this converter is 
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almost as good as if an ADM encoded the original tone. How- 
ever, for a high frequency tone,' the performance is unaccept- 
able . 

We introduce a non-parametric technique to estimate the 
midpoint between PCM samples using four adjacent. PCM points. 
The estimator weights the four adjacent PCM points as if they 
were impulses passing through an ideal low pass filter. A 
linear interpolation is formulated between the PCM points 
and the estimated midpoint. Samples of this interpolation 
are then used as the input to an ADM to achieve conversion. 
The SNR of the non-parametric converter, for both low and 
high frequency sinusoids , comes within 1 dB of the SNR for 
the optimal system, i.e., when the ADM encodes the original 
tone. This converter utilizes only the standard digital 
hardware in its realization and stresses a simple structure 
that can be fabricated on a single, large-scale, integrated 
circuit chip. 
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CHAPTER 1 
INTRODUCTION 


Many modern communication systems utilize digital encod- 
ing techniques because of high quality performance and ease 

i 

in implementation. The rapid advances recently made in the 
integrated circuit technology contribute greatly to the cur- 
rent interest in digital signal processing. Among the 
existing encoding techniques, adaptive delta modulation (ADM) 
and pulse code modulation (PCM) are both very popular and 
widely used in commercial communications . The simplicity of 
the DM system makes it very 'attractive and PCM was the first 
digital encoding technique, dating back to the late 1940s. 
Consequently, we shall restrict ourselves to the processing 
of ADM encoded signals and conversion between ADM and PCM. 

Delta modulation is a technique by which an analog sig- 
nal is encoded into a sequence of binary digits (bits) by 
periodically comparing the analog signal to an estimate 
signal. If the error between the analog signal and the esti- 
mate is positive, then the bit is +1? if it is negative, 
then the bit is -1. The estimate, formed from the entire 
sequence of DM bits, is made to approximate, very closely, 
the analog signal by increasing or decreasing according to 
the current bit. 

'Since the beginning of delta modulation in the early 
1950s [1], this simple method of analog-to-digital (A/D) 
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conversion has undergone many changes. The first DMs con- 
structed and analyzed were compo'sed of analog devices and 
employed a single "leaky" integrator as their feedback cir- 
cuit or estimator [2]. To improve dynamic range, the DM feed- 
back circuit soon became continuously adaptive [3-5] , that 
is, the amount of change that the estimator produced each 
time one bit was transmitted was a function of the past his- 
tory of the signal. It was not long before the feedback cir- 
cuit, and then the entire DM, evolved from analog to all- 
digital devices [6-8]. Currently, we are working with both 
all-digital linear DMs and various types of all-digital adap- 
tive DMs [9]. Although some analysis and evaluation has been 
done [10-13], theoretical studies on any system involving 
ADMs are incomplete, not having treated the nonlinear aspects 
of the ADMs under investigation. 

Throughout this dissertation we confine ourselves to the 
Song audio mode ADM [14] when evaluating performance of the 
systems that have been developed.- However, the designs are 
often general enough to be applied to a large class of digi- 
tal ADMs. All systems in this thesis are designed to be 
practically realizable. Thus, we only consider operations 
which can be constructed with standard digital hardware, that 
is, adders, delays, hard-wired scalars and common logic cir- 
cuits. Consequently, all our ADM devices can be manufactured 
with large scale integration (LSI) where the distinct advan- 
tage is low cost and high reliability. One objective of the 
entire thesis is always to work with digitally encoded sig- 
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nals when developing solutions to our problems . 

The three topics considered in this dissertation deal 
with signals encoded in ADM and PCM formats. The first con- 
centrates on direct arithmetic processing of ADM encoded 
signals. The next explores conversion from ADM format to PCM 
format. And the last studies conversion from PCM format to 
ADM format. 

The first topic is investigated because of the popular 
use of ADM encoded signals and the recent trend toward digi- 
tal processing of signals. The real objective is to elimi- 
nate the need either to demodulate the ADM signal into an 
analog waveform or change to PCM form before processing can 
be done. In Ch. 2 we show that the sum, difference and even 
the product of DM encoded signals can be obtained by operat- 
ing directly on the serial data, i.e., the ADM bit streams. 
The sum, difference and product signals are presented in 
either an ADM or a PCM format. We analyze these -processors , 
discuss their hardware complexity and test them via simula- 
tion on a digital computer. The performance is evaluated 
using a technique developed in Ch . 2. Finally, a comparison 
is made with equivalent PCM processing systems. 

The conversion topics are studied to achieve compati- 
bility between these two widely used encoding techniques. 

We can also facilitate digital processing of signals encoded 
in both ADM and PCM formats by- devising translation units 
between the two systems . In Ch . 3 , a general technique is 
presented for converting from ADM to PCM format without first 
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demodulating the ADM bit stream and returning to the analog 
domain. The converter utilizes' a non-recursive digital fil- 
ter that is designed with ideal low pass filter characteris- 
tics. A 'frequency domain analysis is developed to explain 
why this filtering operation is so vital to the performance 
of this system. The ADM to PCM converter is simulated on a 
digital computer and a family of performance curves is pre- 
sented for the case of ADM encoded sinusoidal signals. We 
also give the performance of an optimal analog conversion 
system to facilitate comparison. 

When considering PCM to ADM conversion we begin by 
pointing out the conceptual difficulties that arise. In 
Ch. 4 we explain several ways to circumvent these diffi- 
culties and introduce an "ADM signal estimate tree" to illus- 
trate the difficulties and to aid in overcoming them. We 
design both parametric and non -parametric PCM to ADM conver- 
ters. The parametric converters utilize the statistics of 
the input signal in their design and the non-parametric con- 
verters are independent of them. A "detailed statistical 
analysis is developed to evaluate the performance of the 
parametric converters. Extensive simulations are performed 
on all these systems and the quality of their operation is 
displayed with families of signal-to-noise ratio (SNR) curves. 

The general results of this thesis are very encouraging. 
The system designs employed to achieve direct ADM processing 
and conversion between ADM and PCM formats are relatively 
simple. All the structures that were developed and simulated 
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could easily be realized with standard digital hardware. The 
SNR curves for the DM processors are either within 1-2 dB 
of the SNR curves for equivalent companded PCM systems or are 
several dB better when the ADM bit rate is lower. Likewise, 
the performance of the converters comes within 1-2 dB of 
the performance of optimal conversion systems. Although we 
have developed satisfactory solutions to the three problems 
investigated, we have, by no means, exhausted these topics. 
There is still room for more research, whether it be theo- 
retical analysis or practical experimentation. 
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CHAPTER _ 2 

DIRECT ARITHMETIC PROCESSING OF ADM ENCODED SIGNALS 


Arithmetic processing of digitally encoded signals is 
traditionally performed on signals that are PCM encoded via 
standard parallel processing techniques. However, it is be- 
coming increasingly popular to use other digital techniques 
to encode signals. We would like to avoid the necessity of 
having to return to a PCM format whenever we must arithmetic- 
ally process these signals. For the case of DM encoded sig- 
nals , it is shown that arithmetic processing can be performed 
by operating directly on the DM bit stream. The direct DM 
processors can be constructed using standard digital hard- 
ware, that is, binary adders, shift registers, exclusive-OR 
gates and hard-wired scalars. The performance of these de- 
vices is shown to be comparable to PCM processors while the 
hardware complexity is equivalent to, and in some cases less 
than, that needed for PCM encoded signals. 

2.1 The Basic Digital DM 

A delta modulator xs essentially a very simple device 
to digitally encode an analog signal. The DM bit stream is 
obtained by hard limiting the difference between the analog 
signal and the DM estimate and transmitting a +1 or a -1 
every clock period. The DM estimate is a function of all 
past DM output bits. We shall be concerned wxth a type of 
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DM which is all-digital in nature. An all-digital DM is one 
that employs only digital circuitry to produce the DM signal 
estimate from the DM bit stream. 

In Fig., 2.1-1, we show the basic form of a digital DM 
which is used in a hardware realization. Let us assume that 
the input signal, x(t) , is bandlimited to f and the DM is 
operating well above the Nyquist rate, i.e., f s >> 2f m , where 
f s is the DM clock frequency. The most general mathematical 
description of a digital DM is given by the following set of 
equations : 

e x (k) = sgn[£ x (k)], (2.1-1) 

S x (k) = x(k) - £(k) (2.1-2) 

and 

a (JO = S(k - 1) + S x (k) , (2.1-3) 

where 

S (k) = the step size at the k tla interval. 

A. 

Equation (2.1-3) arises because the DM estimate, £(k), is the 
accumulation of the step sizes as shown in Fig. 2.1-1, i.e., 

k 

S(k) = Z S fi) . (2.1-4) 

• A. 

l=-0O 

To simplify our discrete signal representation, we have adap- 
ted the notation x(t = kT ) = x (k,) , where T = 1/f is the DM 

5 q S 

clock period. 

To completely specify the particular type of digital DM, 
we must define the step size algorithm used to formulate 
S (k) . For the case of a linear or fixed step DM, 

A 
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S x (k) = Se x (k - 1) . (2.1-5) 

For adaptive DMs there are many step size algorithms where 
the step size adapts to an input signal parameter, generally 
to its power. We shall be concerned with a class of DMs 
derived by minimizing a mean square cost function, i.e., 
those described by the Song Algorithm [15]. In this algo- 
rithm, the step size is a function of the two past DM bits 
and the previous step size. We shall primarily deal with the 
Song audio mode DM, where the step size changes linearly, 
i.e., 

S x (k) = |S x (k - Dle x (k - 1) + Se x (k - 2), (2.1-6) 

where 

S E the magnitude of the minimum step size. 

2.2 Direct DM Additxon/Subtraction 

Consider two signals, x(t) and y(t), both bandlimited to 
f m and both DM encoded so that we have only the sequences 
{e v (k)} and {e (k) } available. The sum and the difference of 

x y 

these two signals are also bandlimited to f m . Generally, 
digital addition (or subtraction) is viewed as the binary sum 
(or appropriate complementing of the subtrahend and then bi- 
nary addition) of two K-bit PCM words. If we prohibit over- 
flow, the result is K-bit PCM words at a rate 2f represent- 
ing the sum or the difference. Since we are restricted to 
the DM sequences of x(t) and y(t) , we wish to obtain the 
direct sum of these two signals by performing basic arithme- 
tic processing on the two sequences. To achieve this, we 
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form the direct sum, a D (k), as the sum of the individual sig- 
nal estimates, that is, 

a D (k) = x(k) + y (k) . (2.2-1) 

Using Eq. (2.1-3) for the estimates of x(t) and y(t), we ob- 
tain a design equation for the direct sum as a recursive re- 
lationship , 

a D (k) = a D (k - 1) + S x (k) + S (k) , (2.2-2) 

where the step sizes are formed directly from the DM bits. 

The direct sum, a D (k), is available in PCM format be- 
cause the step sizes, used in the design equation, are gener- 
ated as parallel binary words. To obtain the DM bit stream 
of the sum, {e (k)}, we merely pass a n (k) through a digital 
DM. A block diagram showing the structure for the sum of DM 
encoded signals is presented in Fig. 2.2-1. The DM digital 
feedback circuit shown in this figure is constructed with the 
appropriate step size network followed by an accumulator. 
Thus, to physically realize the entire DM direct sum system, 
it requires only a full adder, an accumulator and the neces- 
sary step sxze network. 

One way 'to subtract DM encoded signals is to add the 

negative of the subtrahend signal. If we wish to form 

x(t) - y(t), we must change +S,,(k) to -S fk) in our design 

i y 

equation. Taking the direct difference, d D (k), as the dif- 
ference between the signal estimates, we obtain 

d D (k) = d D (k - 1) + S x (k) - S y (k). 


(2.2 r 3) 
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b^RODUCtBlLITY OF the 

■ vrNAL PAGE IS POOR 

Thus, the subtraction algorithm has the same structure as the 

addition algorithm shown in Fig". 2.2-1. Another, even easier 
method to obtain the difference merely entails inverting each 
DM bit of the subtrahend signal. This produces -e^(k) and, 
for the DM step size algorithm cited above, -Sy(k). There- 
fore, Fig. 2.2-1 becomes a sub tractor by placing an inverter 
after e (k) . 

The structure derived above is completely independent 
of the type of DM and is therefore universal for any digital 
DM definable by Eqs . (2.1-1) through (2.1-3) . To realize the 

direct sum of signals encoded by a particular type of DM, we 
must construct the circuitry for the step size algorithm em- 
ployed in the original DM encoder. For the modes cited above, 
the step size circuitry is constructed with standard digital 
hardware, i.e., full adders, delays, scalers and exclusive- 
OR gates. The DM adder for the linear mode is given in 
Fig. 2.2-2. By applying the Song audio mode algorithm, we 
can realize the DM adder which is shown in Fig. 2.2-3. 

The latter device requires multiplications by e(k) = 

±1 and absolute value operations. Since obtaining the mag- 
nitude of a quantity is equivalent to multiplication by +1 
if it is positive and by -1 if it is negative, we only need 
to explain the realization of a multiplication by e(k) using 
exclusive-OR gates . We shall assume that the internal arith- 
metic employed is offset binary. For other types of internal 
arithmetic, similar realizations can be achieved with differ- 
ent logic gates. The main characteristic of offset binary 
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arithmetic is its complementary symmetry about the zero axis; 
that is, the complement of any quantity represents the nega- 
tive of that quantity. If we multiply by e(k) = +1, i.e. , a 
binary 1, we leave the quantity unchanged; and if we multi- 
ply by e{k) = -1, i.e., a binary 0, we complement the quan- 

tity. This operation is easily realized with a bank of ex- 
clusive-NOR gates . 

In the DM adders, and in all ensuing digital circuits, 
we shall restrict ourselves to numerical scaling by I/2 N , 
where I and N are positive integers with I < 2 N and N repre- 
senting the number of bits in our internal arithmetic. Any 
number of this form is express able as 

N 

I/2 N = Z (2.2-4) 

i=l 1 


where 


a* = 0 or 1. 

Since a scaling by 1/2 1 represents a simple shift by i-bits, 
a scale factor of 1/2^ can be hard-wxred as a sum of i-bit 
shifts using only a series of full adders. We emphasize this 
scaling technique even though multipliers, which will pro- 
duce the same net result, are readily available on an inte- 
grated circuit (IC) chip. The hard-wiring decreases proces- 
sing time and makes implementation easier because less com- 
ponents are required. 


2 . 3 Averaging Filter 


The steady state response of all types of digital DMs to 
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a constant input is an estimate signal which has been found 
to exhibit a periodic pattern. -For a linear DM, the esti- 
mate is a simple square wave with a period of two sampling 
intervals. For any Song mode DM, the signal estimate is 
found to exhibit a periodic pattern which repeats every four 
sampling instants and which is symmetric about the quantized 
value of the input. In Fig. 2.3-1, we show a typical steady 
state estimate signal for the Song audio mode. In this 
figure, the constant input, x, has been quantized to x where 

Xg - S/2 < x < Xg, + S/2 (2.3-1) 

and m is a non-negative integer limited by M. If we specify 
the amplitude range of the DM encoder as V pp and allow the 
steady state pattern to span this range, then 

(2M + 1)S < V . (2 . 3-2a) 

irir 

Consequently , 

M < <V pp - S)/2S. (2 .3 -2b) 

If the internal arithmetic of the DM encoder has B bits , 
then the minimum step size is 

S = V pp /2 B (2.3-3) 

and the upper bound on m can be given as 

M < 2^! . (2. 3.-4) 

Since the direct sum, a D (k), was formulated as the sum 




Fig. 2.3-1; Steady State Estimate Signal of the Song Audio Mode DM 
to a Constant Input 
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of the individual signal estimates, we expect it to exhibit 
a periodic pattern when respondihg to constant inputs. For 
the Song, audio mode, there are four possible steady state 
direct sum waveforms. A typical waveform, which can repre- 
sent all four, is given in Fig. 2.3-2. In this figure, both 
n and r are non-negative integers less than or equal to 2M 
and y q is the quantized value of the constant input y where 

y q - S/2 < y < y g + S/2. (2.3-5) 

The important property of the four possible steady state 

direct sum patterns is that the arithmetic average of any 

four consecutive values of a D (k) is always equal to X q + 

y , This fact inspired the use of a four-term averaging fil 
y 

ter after a D (k). 

The four-term non-recursive filter that was employed is 
described by the following equation: 

' A(k) = ~[a D (]c) + a D (k - 1) + a D (k - 2) + a Q (k - 3)]. 

(2.3-6) 

If we apply Eq. (2.3-6) to the waveform given in Fig. 2.3-2, 
the result is 

’ A (k) = x + y (2.3-7) 

for all k, as long as a D (k) has reached steady state. Thus, 
after a four-term averaging filter, the DM sum produces the 
same result, for constant inputs, obtainable by PCM addition 
To realize this filter, we need not use the structure 




Fig. 2.3-2. Steady State Direct Sum for the Song Audio Mode DM 
with Constant Inputs 
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dictated by Eq. (2.3-6). We can save hardware by employing 
the realization shown in Fig. (2.3-3) which uses two, 
rather than three, adders. In general, by extending this 
structure, it is possible to realize any N-term averaging 
filter, where N = and t is a positive integer, in a 
similar fashion. The advantage is that, instead of needing 
2 fc - 1 adders in the realization, only t adders are required. 

To illustrate the function of the four-term averaging 
filter, we shall determine its digital transfer function, 

H (z). Assuming zero initial conditions and taking the 

cl 

Z-transform of Eq. (2.3-6), we obtain 

H (z) = - M g l = ±(1 + z" 1 + z“ 2 + z“ 3 ) . (2.3-8) 

a a D (z) 4 

To display the frequency characteristics of this filter, we 
let z = exp(jwT s ) and find that 

|H (w) [ = ] cos (wT_/2) cos (wT ) ( . (2.3-9) 

In Fig. (2.3-4), we plot | H a (co ) j on an abscissa normalized 
to f g . A complete derivation of Eq. (2.3-9) is given in 
App . 1 . 

From Fig. (2.3-4) and Eq. (2.3-9), we observe that 

H (to) has zeros at integer multiples of f /4 when the inte- 
a s 

ger is divisible by 4. It is precisely the first zero that 
eliminates the four-sampling-interval periodic component in 
the direct sum. The four-term averaging filter exhibits low 
pass filter (LPF) characteristics and even slightly attenu- 








I |H„(f)| 




Fig. 2.3-4. Amplitude-Frequency Characteristics of the Four-Term 

Non- Recursive Averaging Filter M 
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at.es baseband frequencies. Thus, care must be taken in uti- 
lizing this filter because it can introduce some distortion 
to baseband signals. However, if the maximum baseband fre- 
quency is in, the area of f s /10 , then distortion will be mini- 
mal since |H a (f = f s /10) j = 0.77, which is well above the 
3 dB point of this filter. This is not an unreasonable re- 
quirement because the audio mode DM generally operates at 
f s = 32K bits /second and speech is usually bandlimited to 
2500 to 3500 Hz. 


2.4 Direct DM Multiplx cation 

Traditionally digital multiplication is treated as a 
static operation; that is, two K-bit PCM words are either 
fed into a combinatoric circuit or into a read only memory 
(ROM) that has been built to perform the multiplication 
operation. We could even use a random access memory (RAM) 
that has been preset to multiply, with the appropriate 
input logic cxrcuit . The result is the product in the form 
of a 2K-bit PCM word. There are, of course, dynamic tech- 
niques capable of performing digital multiplication and we 
shall discuss them in connection with hardware complexity. 
In either -case, if we wish to multiply two signals, both 
bandlimited to f , then we must perform the static or dy- 
namic operation on PCM words from each signal at a rate of 
4f m to obtain the product in a PCM format. This is because 
the product will be bandlimited to 2f m as we know from the 
convolution theorem. This point is important for our later 
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performance comparison with PCM. There are other ways to 
obtain the product in PCM form by using the samples of both 
signals at a rate of 2f . This matter is further pursued 

in App . 2 . 

• < 

The problem that we consider here is the formation- of 
the product of x(t) and y{t) when we only have their DM se- 
quences, {e x (k}} and {.e y (k)}, available. Once again we re- 
strict ourselves to a design structure that can be imple- 
mented with standard digital hardware. Forming the direct 
product as the product of the individual signal estimates, 
we have 


P D <k) = x (k)y (k) . (2.4-1) 

As in the case of the direct sum, we can develop a recursive 
relationship as follows: 


P D 0O = p D (k - 1) + S y (k)x(k - 1) + S x (k)y(k - 1) 
'+ S x (k)S y (k). 


(2.4-2) 


The basic block diagram showing the direct product, in PCM 
format [p D (k)j and in DM format [e (k)], is given in Fig. 
(2.4-1). Although the structure for the direct product is 
universal for any digital DM definable by Eqs . (2.1-1). 
through (2.1-3), it will be useful only if the step size 
algorithm is such that. we can recursively realize the 
particle products, that is, the last three terms in Eq. 
(2.4-2) . 




Fig. 2.4-1. Direct Product of DM 






REPRODUCIBILITY OF THE 
ORIGINAL PAGE IS POOR 

For the linear DM, no difficulty arises and the direct 
product is 


P D 0O = p D (k - 1) + Se y (k - l)x(k - 1) + Se x (k - l)y(k - 1) 


+ S 2 e x (k - l)-e (k - 1) . 


(2.4-3) 


The realization of this system, shown in Fig. (2.4-2);, is 
extremely easy because there are no non'-linear operations , 
only simple scaling including multiplication by +1 or -1. 

To derive the recursive relationships for the partial 
products with the Song audio mode algorithm, we must use a 
step size relationship common to all types of DMs , that is. 


S x (k) = |S x (k) |e x (k - 1) . 


(2.4-4) 


This equation says that the sign of the present step size, 

S„(k), is dictated by the past DM output bit, e x (k - 1) . 

From Eq. (2.1-6), we see that this property is applicable 

for the Song audio mode as long as js x (k - 1) j >_ S . If 

S (k - 1) = 0 and e v (k - 1) = e Y (k - 2) ,, then this property 
x x , A 

is also valid. Only when S x (k - 1) =0 and e x (k - 1) f 
e (k - 2) , the step size relationship becomes invalid. This 

X 

invalidity is caused' by a hardware limitation that allows 
the step size to be zero rather than an arbitrarily small 
value. We shall show,- however, that the condition of 
invalidity has a very low probability o'f occurrence and the 
resulting signal' estimate used in' the multiplication algo- 
rithm does not substantially degrade the product. 
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Equation (2.4-4) can only be invalid when S x (’k) = 0. 

.A .zero step size occurs primarily when -the ADM is in its 
minimum steady. state pattern. That is, the estimate resem- 
bles Fig. 2.3-1 when- m = 0. This corresponds to the audio 
signal being zero because, in speech, 50% of the time there 
is no voice. Recently, step size statistics have been ob- 
-tained for the Song audio mode ADM, using actual speech sig- 
nals. They show that the -probability of a zero step size is 
approximately 0.04 when f s = 32K bits/second . Since S x (k) 

= 0 occurs twice in a minimum steady state estimate pattern, 
the probability of such a pattern is 0.08. Let us assume 
that the audio signal is equally likely to increase or de- 
crease from its zero, value . in any of the four periods of the 
-steady state pattern. Only 2 of the 8 signal variations 
give rise to the condition when.Eq. (2.4-4) will be invalid. 
Therefore, the probability of invalidity is 0.02. 

We have created a situation in Fig,. 2.4-3 where the 
step size relationship is invalid. The -solid curve repre- 
sents the true ADM, estimate- and the broken line waveform is 
the estimate used in the multiplication algorithm. From 
this figure, we observe that the estimate used in the multi- 
plication algorithm is' just as good an approximation to the 
audio signal as the' true estimate. We shall see, in Sec.- 
2.8.3, that -the use of Eq. (2.4-2) does not noticeably ef- 
fect the output SNR of the DM multiplier. 

Now that we have justified the step size relationship, 
we can use it to express recursively the partial products 




Fig. 2.4-3. Example when the Step Size Relationship is Invalid 
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for the Song audio mode: 

S y (k)x(k - 1) = S y (k - l)x(k - 2 ) e y (k -l)e y .(k - 2) 

+ S x <k - l)S y (k - 1) e y (k - l)e y (k - 2) (2.4-5) 

+ x(k - l)Se (k - 2) , ■ 

- S x (k)y(k - 1) = S x (k - 1) y (k - 2)e x (k - l)e x (k - 2) 

+ S y (k - l)S x (k - l)e x (k - l')e x (k - 2) (2.4-6)' 

+ Y (k - l)Se x (k - 2) , 

S x (k)S y (k) = |s x (k - l)S y (k - 1) | e x (k - 1) e y (k - 1) 

+ S|S x (k - 1) |e x (k l)e y (k - 2) 

(2.4-7) 

+ S | S y (k - 1) | e y (k - l)e x (k - 2) 

+ S 2 e x (k - 2)e y (k - 2) . ‘ 

Equations (2.4-5), (2.4-6) and (2.4-7) are readily realiz- 
able with standard digital hardware similar to the DM 
adder shown in Fig. 2.2-3. These three terms can be con- 
structed with nothing more complicated than adders, delays, 
hard-wired scalers and exclusive-OR gates to multiply by il 
and produce the absolute value. 

All of the design structures that we have derived are 
accumulator type systems. For both the adder (Sec. 2.3) and 
the multiplier (Sec. 2.4), for all DM modes, the present out- 



31 


put is equal to the past output plus additional terms. 

Thus , it is important to begin with the- correct initial 
condition for the past output, or else suffer a' constant 
offset error. It is convenient to start with both signals, 
x (t) and y(t) , at zero so that we can employ a zero initial • 
condition for the past output. 

As in the case of the direct sum, we expect the 'direct, 
product, since it is formulated as the product of the indi- 
vidual signal estimates, to exhibit a periodic pattern when 
responding to constant inputs. When using the Song audio 
mode algorithm, the direct product generates four possible • 
steady state waveforms. In Fig. 2.4-4, we show the general 
structure of a steady state waveform. The values of -Cj and 

C~ depend upon x and y and the amplitude of the steady 

q q 

state error pattern (x - x -and y - y ) , while d x and d 2 de- 

H U 

pend only on the latter of these two. .The numerical values 
of d 1 and d 2 can be entirely different, but they both have 
the same form, as can be seen by multiplying two steady 
state patterns together, that is. 


where 


and 


| d ± |- = L/4, 
i = 1 , ’ 2 , 

L = a positive integer 
L < 4M 2 + 4M + 1 


(2.4-8) 


where M is bounded in Eq. (2.3-4). 
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The arithmetic average of any four consecutive values 
of p^(k) always equals the product of the quantized values 
of the inputs plus a second-order term depending on S 2 . 

This warrants the use of the following four-term non-recur- 
sive filter after p D (k): 

P{k) = ±[p (k) + P D (k ~'l) + p D (k - 2) + p D (k - 3)3. (2.4-10) 

Applying Eq. (2.4-10) to the waveform shown in Fig. 2.4-3, 
we see that 

P(k) = x y + (d + d ) S 2 /2 (2.4-11) 

for all k, as long as p D (k) has reached the steady state. 

We have found, through computer simulations, that the fac- 
tor (d x + d 2 )/2 generally is no larger than 10 or 20. In a 
practical DM encoder with 10 bits of internal arithmetic 
and an amplitude range of V = 10 volts, the minimum step 
size, S, will be approximately 10 millivolts. Therefore, 
the second-order term will be in the order of 1-2 millivolts . 

Even if we allow (d +'d )/2 to be 100, the error only 

1 2 

reaches 10 millivolts or one minimum step size. Certainly, 

one step size out of 1024 can be considered insignificant. 

For any reasonably small value of step size, the second 

order term, (d + d )S 2 /2, is negligible and thus, after 
1 2 

the four-term averaging filter, the DM product yields a re- 
sult almost identical to the PCM product. 

The direct DM product design structure that we have 
derived is not a unique solution to this problem. The de- 
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performance comparison with PCM. There are other ways to 
obtain the product in PCM form by using the samples of both 
signals at a rate of 2f . This matter is further pursued 

in App . 2 . 

• < 

The problem that we consider here is the formation- of 
the product of x(t) and y{t) when we only have their DM se- 
quences, {e x (k}} and {.e y (k)}, available. Once again we re- 
strict ourselves to a design structure that can be imple- 
mented with standard digital hardware. Forming the direct 
product as the product of the individual signal estimates, 
we have 


P D <k) = x (k)y (k) . (2.4-1) 

As in the case of the direct sum, we can develop a recursive 
relationship as follows: 


P D 0O = p D (k - 1) + S y (k)x(k - 1) + S x (k)y(k - 1) 
'+ S x (k)S y (k). 


(2.4-2) 


The basic block diagram showing the direct product, in PCM 
format [p D (k)j and in DM format [e (k)], is given in Fig. 
(2.4-1). Although the structure for the direct product is 
universal for any digital DM definable by Eqs . (2.1-1). 
through (2.1-3), it will be useful only if the step size 
algorithm is such that. we can recursively realize the 
particle products, that is, the last three terms in Eq. 
(2.4-2) . 




Fig. 2.4-1. Direct Product of DM 
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For the linear DM, no difficulty arises and the direct 
product is 


P D 0O = p D (k - 1) + Se y (k - l)x(k - 1) + Se x (k - l)y(k - 1) 


+ S 2 e x (k - l)-e (k - 1) . 


(2.4-3) 


The realization of this system, shown in Fig. (2.4-2);, is 
extremely easy because there are no non'-linear operations , 
only simple scaling including multiplication by +1 or -1. 

To derive the recursive relationships for the partial 
products with the Song audio mode algorithm, we must use a 
step size relationship common to all types of DMs , that is. 


S x (k) = |S x (k) |e x (k - 1) . 


(2.4-4) 


This equation says that the sign of the present step size, 

S„(k), is dictated by the past DM output bit, e x (k - 1) . 

From Eq. (2.1-6), we see that this property is applicable 

for the Song audio mode as long as js x (k - 1) j >_ S . If 

S (k - 1) = 0 and e v (k - 1) = e Y (k - 2) ,, then this property 
x x , A 

is also valid. Only when S x (k - 1) =0 and e x (k - 1) f 
e (k - 2) , the step size relationship becomes invalid. This 

X 

invalidity is caused' by a hardware limitation that allows 
the step size to be zero rather than an arbitrarily small 
value. We shall show,- however, that the condition of 
invalidity has a very low probability o'f occurrence and the 
resulting signal' estimate used in' the multiplication algo- 
rithm does not substantially degrade the product. 
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Equation (2.4-4) can only be invalid when S x (’k) = 0. 

.A .zero step size occurs primarily when -the ADM is in its 
minimum steady. state pattern. That is, the estimate resem- 
bles Fig. 2.3-1 when- m = 0. This corresponds to the audio 
signal being zero because, in speech, 50% of the time there 
is no voice. Recently, step size statistics have been ob- 
-tained for the Song audio mode ADM, using actual speech sig- 
nals. They show that the -probability of a zero step size is 
approximately 0.04 when f s = 32K bits/second . Since S x (k) 

= 0 occurs twice in a minimum steady state estimate pattern, 
the probability of such a pattern is 0.08. Let us assume 
that the audio signal is equally likely to increase or de- 
crease from its zero, value . in any of the four periods of the 
-steady state pattern. Only 2 of the 8 signal variations 
give rise to the condition when.Eq. (2.4-4) will be invalid. 
Therefore, the probability of invalidity is 0.02. 

We have created a situation in Fig,. 2.4-3 where the 
step size relationship is invalid. The -solid curve repre- 
sents the true ADM, estimate- and the broken line waveform is 
the estimate used in the multiplication algorithm. From 
this figure, we observe that the estimate used in the multi- 
plication algorithm is' just as good an approximation to the 
audio signal as the' true estimate. We shall see, in Sec.- 
2.8.3, that -the use of Eq. (2.4-2) does not noticeably ef- 
fect the output SNR of the DM multiplier. 

Now that we have justified the step size relationship, 
we can use it to express recursively the partial products 




Fig. 2.4-3. Example when the Step Size Relationship is Invalid 


30 


for the Song audio mode: 

S y (k)x(k - 1) = S y (k - l)x(k - 2 ) e y (k -l)e y .(k - 2) 

+ S x <k - l)S y (k - 1) e y (k - l)e y (k - 2) (2.4-5) 

+ x(k - l)Se (k - 2) , ■ 

- S x (k)y(k - 1) = S x (k - 1) y (k - 2)e x (k - l)e x (k - 2) 

+ S y (k - l)S x (k - l)e x (k - l')e x (k - 2) (2.4-6)' 

+ Y (k - l)Se x (k - 2) , 

S x (k)S y (k) = |s x (k - l)S y (k - 1) | e x (k - 1) e y (k - 1) 

+ S|S x (k - 1) |e x (k l)e y (k - 2) 

(2.4-7) 

+ S | S y (k - 1) | e y (k - l)e x (k - 2) 

+ S 2 e x (k - 2)e y (k - 2) . ‘ 

Equations (2.4-5), (2.4-6) and (2.4-7) are readily realiz- 
able with standard digital hardware similar to the DM 
adder shown in Fig. 2.2-3. These three terms can be con- 
structed with nothing more complicated than adders, delays, 
hard-wired scalers and exclusive-OR gates to multiply by il 
and produce the absolute value. 

All of the design structures that we have derived are 
accumulator type systems. For both the adder (Sec. 2.3) and 
the multiplier (Sec. 2.4), for all DM modes, the present out- 
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put is equal to the past output plus additional terms. 

Thus , it is important to begin with the- correct initial 
condition for the past output, or else suffer a' constant 
offset error. It is convenient to start with both signals, 
x (t) and y(t) , at zero so that we can employ a zero initial • 
condition for the past output. 

As in the case of the direct sum, we expect the 'direct, 
product, since it is formulated as the product of the indi- 
vidual signal estimates, to exhibit a periodic pattern when 
responding to constant inputs. When using the Song audio 
mode algorithm, the direct product generates four possible • 
steady state waveforms. In Fig. 2.4-4, we show the general 
structure of a steady state waveform. The values of -Cj and 

C~ depend upon x and y and the amplitude of the steady 

q q 

state error pattern (x - x -and y - y ) , while d x and d 2 de- 

H U 

pend only on the latter of these two. .The numerical values 
of d 1 and d 2 can be entirely different, but they both have 
the same form, as can be seen by multiplying two steady 
state patterns together, that is. 


where 


and 


| d ± |- = L/4, 
i = 1 , ’ 2 , 

L = a positive integer 
L < 4M 2 + 4M + 1 


(2.4-8) 


where M is bounded in Eq. (2.3-4). 
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The arithmetic average of any four consecutive values 
of p^(k) always equals the product of the quantized values 
of the inputs plus a second-order term depending on S 2 . 

This warrants the use of the following four-term non-recur- 
sive filter after p D (k): 

P{k) = ±[p (k) + P D (k ~'l) + p D (k - 2) + p D (k - 3)3. (2.4-10) 

Applying Eq. (2.4-10) to the waveform shown in Fig. 2.4-3, 
we see that 

P(k) = x y + (d + d ) S 2 /2 (2.4-11) 

for all k, as long as p D (k) has reached the steady state. 

We have found, through computer simulations, that the fac- 
tor (d x + d 2 )/2 generally is no larger than 10 or 20. In a 
practical DM encoder with 10 bits of internal arithmetic 
and an amplitude range of V = 10 volts, the minimum step 
size, S, will be approximately 10 millivolts. Therefore, 
the second-order term will be in the order of 1-2 millivolts . 

Even if we allow (d +'d )/2 to be 100, the error only 

1 2 

reaches 10 millivolts or one minimum step size. Certainly, 

one step size out of 1024 can be considered insignificant. 

For any reasonably small value of step size, the second 

order term, (d + d )S 2 /2, is negligible and thus, after 
1 2 

the four-term averaging filter, the DM product yields a re- 
sult almost identical to the PCM product. 

The direct DM product design structure that we have 
derived is not a unique solution to this problem. The de- 
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sign presented does, however, perforin well and this will be 
seen from the simulation responses for elementary input 
waveforms and also from the SNR performance curves. There 
are other design techniques that could have been incorpora- 
ted into the direct product design. We could introduce a . 
"leak" factor- in Eq. (2.4-2) and feedback a fraction of the 
output, p D (k), to generate, say 0.9p D (k - 1). Alternately, 
we might use a different averaging filter after p Q (k); or 
we could perform some kind of averaging on x(k) and y(k) be- 
fore we form their product. Each of these ideas would have 
to be analyzed individually to determine its merits and 
shortcomings - in formulating the direct DM product. 

2.5 Hardware Complexity 

From Eq. (2.2-2) or Fig. 2.2-1 we see that the complex- 
ity and quantity of the hardware needed for a DM adder is 
essentially equivalent to that needed for a PCM adder. In 
PCM addition, since we have two K-bit words coming from 
x(t) and y(t), we require .two K-bit input storage registers, 
one K-bit full adder and, since we do- not allow overflow, 
one K-bit output register . To obtain the DM direct sum, we 
need the step size circuitry for both signals (some of which 
can be time shared) terminating in registers with less than 
K-bit capacity, one transfer register with enough bits to 
represent twice the maximum step size, one K-bit full adder 
and one K-bit delay register. • . - 

The -comparison of hardware complexity for multiplica— 
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tion is somewhat more involved. PCM multiplication is gen- 
erally treated as a static operation where two K-bit words 
are either fed into a combinatorial circuit, or into a pre- 
programmed ROM, or into a repeating add-store-and-shif t cir- 
cuit. We must also remember that to multiply two signals, 
bandlimited to f , we must perform this static operation on 
the PCM words' from the two signals at a rate of 4f since 
the product will be bandlimited to 2f m . 

Now we can examine the hardware complexity needed for 
these PCM multipliers. A combinatorial circuit needs two 
K-bit input storage registers, K 2 AND gates, K K-bit full 
adders and a 2K-bit output storage register. This is 
easily seen by observing the structure that arises when we 
use "long" multiplication to obtain the product of two K-bit 
words, A •••A A and B„*“B B . A ROM, with a 2K-bit input 

j\ 2 1 2 1 

•address, normally has 2 2k memory locations. Even though 
there are only K 2 different product values, the ROM must 
• still use 2 2K memory locations to multiply as well as need- 
ing input and output registers. The repeating add-store- 
and-shift device requires two K-bit input registers, a K-bit 
shift register, K AND gates, a 2K-bit full adder and a 
2K-bit output register. However, for this last multiplier, 
we must perform K repeated additions in the time interval 
1/4 f m before we obtain the final product word. 

Considering the DM multiplier for the linear mode, as 
shown in Fig. 2.4-2, the hardware needed is. two 2-bit shift 
registers , two accumulators {each having a K-bit full adder 




Fig. 2.4-3. Example when the Step Size Relationship is Invalid 
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for the Song audio mode: 

S y (k)x(k - 1) = S y (k - l)x(k - 2 ) e y (k -l)e y .(k - 2) 

+ S x <k - l)S y (k - 1) e y (k - l)e y (k - 2) (2.4-5) 

+ x(k - l)Se (k - 2) , ■ 

- S x (k)y(k - 1) = S x (k - 1) y (k - 2)e x (k - l)e x (k - 2) 

+ S y (k - l)S x (k - l)e x (k - l')e x (k - 2) (2.4-6)' 

+ Y (k - l)Se x (k - 2) , 

S x (k)S y (k) = |s x (k - l)S y (k - 1) | e x (k - 1) e y (k - 1) 

+ S|S x (k - 1) |e x (k l)e y (k - 2) 

(2.4-7) 

+ S | S y (k - 1) | e y (k - l)e x (k - 2) 

+ S 2 e x (k - 2)e y (k - 2) . ‘ 

Equations (2.4-5), (2.4-6) and (2.4-7) are readily realiz- 
able with standard digital hardware similar to the DM 
adder shown in Fig. 2.2-3. These three terms can be con- 
structed with nothing more complicated than adders, delays, 
hard-wired scalers and exclusive-OR gates to multiply by il 
and produce the absolute value. 

All of the design structures that we have derived are 
accumulator type systems. For both the adder (Sec. 2.3) and 
the multiplier (Sec. 2.4), for all DM modes, the present out- 
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racy .of' the product, while, at the same time, increasing the 
complexity of the hardware. 


2.6 SNR with Constant Inputs 

Consider 'first the SNR obtained by adding two statis- 
tically independent constant signals, such as x and y, that 
are PCM encoded. Defining the quantized samples as and 
y , and the respective errors as e x and e v , the PCM sum is 
seen to be 


a q = x q + V 

where 


and 



( 2 . 6 - 1 ). 


( 2 . 6 - 2 ) 



(2.6-3) 


We can also express the PCM sum as 

a = a - e , 
q a 

where the tr.ue sum is 

a = x + y 


(2.6-4) 


(2.6-5) 


and the sum error is 


s = e + e . 
a x y 


( 2 . 6 - 6 ) 


If the minimum step size, S, is the distance between PCM 
levels and it is sufficiently small, then e x and will be 
equally likely in the interval [-S/2 , S/2], One can readily 
show [16] that 




Fig. 2.4-1. Direct Product of DM 
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ORIGINAL PAGE IS POOR 

For the linear DM, no difficulty arises and the direct 
product is 


P D 0O = p D (k - 1) + Se y (k - l)x(k - 1) + Se x (k - l)y(k - 1) 


+ S 2 e x (k - l)-e (k - 1) . 


(2.4-3) 


The realization of this system, shown in Fig. (2.4-2);, is 
extremely easy because there are no non'-linear operations , 
only simple scaling including multiplication by +1 or -1. 

To derive the recursive relationships for the partial 
products with the Song audio mode algorithm, we must use a 
step size relationship common to all types of DMs , that is. 


S x (k) = |S x (k) |e x (k - 1) . 


(2.4-4) 


This equation says that the sign of the present step size, 

S„(k), is dictated by the past DM output bit, e x (k - 1) . 

From Eq. (2.1-6), we see that this property is applicable 

for the Song audio mode as long as js x (k - 1) j >_ S . If 

S (k - 1) = 0 and e v (k - 1) = e Y (k - 2) ,, then this property 
x x , A 

is also valid. Only when S x (k - 1) =0 and e x (k - 1) f 
e (k - 2) , the step size relationship becomes invalid. This 

X 

invalidity is caused' by a hardware limitation that allows 
the step size to be zero rather than an arbitrarily small 
value. We shall show,- however, that the condition of 
invalidity has a very low probability o'f occurrence and the 
resulting signal' estimate used in' the multiplication algo- 
rithm does not substantially degrade the product. 
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sign presented does, however, perforin well and this will be 
seen from the simulation responses for elementary input 
waveforms and also from the SNR performance curves. There 
are other design techniques that could have been incorpora- 
ted into the direct product design. We could introduce a . 
"leak" factor- in Eq. (2.4-2) and feedback a fraction of the 
output, p D (k), to generate, say 0.9p D (k - 1). Alternately, 
we might use a different averaging filter after p Q (k); or 
we could perform some kind of averaging on x(k) and y(k) be- 
fore we form their product. Each of these ideas would have 
to be analyzed individually to determine its merits and 
shortcomings - in formulating the direct DM product. 

2.5 Hardware Complexity 

From Eq. (2.2-2) or Fig. 2.2-1 we see that the complex- 
ity and quantity of the hardware needed for a DM adder is 
essentially equivalent to that needed for a PCM adder. In 
PCM addition, since we have two K-bit words coming from 
x(t) and y(t), we require .two K-bit input storage registers, 
one K-bit full adder and, since we do- not allow overflow, 
one K-bit output register . To obtain the DM direct sum, we 
need the step size circuitry for both signals (some of which 
can be time shared) terminating in registers with less than 
K-bit capacity, one transfer register with enough bits to 
represent twice the maximum step size, one K-bit full adder 
and one K-bit delay register. • . - 

The -comparison of hardware complexity for multiplica— 
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tion is somewhat more involved. PCM multiplication is gen- 
erally treated as a static operation where two K-bit words 
are either fed into a combinatorial circuit, or into a pre- 
programmed ROM, or into a repeating add-store-and-shif t cir- 
cuit. We must also remember that to multiply two signals, 
bandlimited to f , we must perform this static operation on 
the PCM words' from the two signals at a rate of 4f since 
the product will be bandlimited to 2f m . 

Now we can examine the hardware complexity needed for 
these PCM multipliers. A combinatorial circuit needs two 
K-bit input storage registers, K 2 AND gates, K K-bit full 
adders and a 2K-bit output storage register. This is 
easily seen by observing the structure that arises when we 
use "long" multiplication to obtain the product of two K-bit 
words, A •••A A and B„*“B B . A ROM, with a 2K-bit input 

j\ 2 1 2 1 

•address, normally has 2 2k memory locations. Even though 
there are only K 2 different product values, the ROM must 
• still use 2 2K memory locations to multiply as well as need- 
ing input and output registers. The repeating add-store- 
and-shift device requires two K-bit input registers, a K-bit 
shift register, K AND gates, a 2K-bit full adder and a 
2K-bit output register. However, for this last multiplier, 
we must perform K repeated additions in the time interval 
1/4 f m before we obtain the final product word. 

Considering the DM multiplier for the linear mode, as 
shown in Fig. 2.4-2, the hardware needed is. two 2-bit shift 
registers , two accumulators {each having a K-bit full adder 
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tion is somewhat more involved. PCM multiplication is gen- 
erally treated as a static operation where two K-bit words 
are either fed into a combinatorial circuit, or into a pre- 
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there are only K 2 different product values, the ROM must 
• still use 2 2K memory locations to multiply as well as need- 
ing input and output registers. The repeating add-store- 
and-shift device requires two K-bit input registers, a K-bit 
shift register, K AND gates, a 2K-bit full adder and a 
2K-bit output register. However, for this last multiplier, 
we must perform K repeated additions in the time interval 
1/4 f m before we obtain the final product word. 

Considering the DM multiplier for the linear mode, as 
shown in Fig. 2.4-2, the hardware needed is. two 2-bit shift 
registers , two accumulators {each having a K-bit full adder 
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and a K-bit storage register), 2K+1 exclusive-OR gates, a 
2K-bit transfer register, a 2K-bit full adder and a 2K-bit 
output register. This hardware complexity is equivalent to 
that needed in the repeating add-store-and-shif t PCM multi- 
plier. Of course, the amount of hardware needed for the DM 
device depends on the step size algorithm employed. 

Finally, we observe that, as the number of. bits in- 
creases, the amount of hardware increases linearly with K 
for any DM multiplier'. This is not true for all PCM multi- 
pliers . The complexity of the" combinatorial circuit and 
the- ROM increases as K 2 and 2 2k , respectively. Although 
the complexity of the repeating add-store-and-shif t, circuit 
increases linearly • with K, the time required to obtain the 
product of two K-bit words also .increases linearly with K. 

When evaluating the total complexity of our DM multi- 
plier, we conclude that the hardware required is comparable 
to a PCM multiplier. Signals are generally encoded with an 
ADM, where the step size algorithm, and consequently the 
required product circuitry, is' somewhat more involved than 
when a linear DM is used as the encoder. However, the DM 
multiplier performs all its operations directly on the DM 
bit streams, a concept never considered heretofore in digi- 
tal signal processing where DM signals were involved. The 
conventional alternative is to convert the DM bits into PCM 
format first. This would give rise' to a conversion error. 
Then we can perform PCM -multiplication , but this would in- 
crease the conversion .error and further add to the inac.cu- 
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performance comparison with PCM. There are other ways to 
obtain the product in PCM form by using the samples of both 
signals at a rate of 2f . This matter is further pursued 

in App . 2 . 

• < 

The problem that we consider here is the formation- of 
the product of x(t) and y{t) when we only have their DM se- 
quences, {e x (k}} and {.e y (k)}, available. Once again we re- 
strict ourselves to a design structure that can be imple- 
mented with standard digital hardware. Forming the direct 
product as the product of the individual signal estimates, 
we have 


P D <k) = x (k)y (k) . (2.4-1) 

As in the case of the direct sum, we can develop a recursive 
relationship as follows: 


P D 0O = p D (k - 1) + S y (k)x(k - 1) + S x (k)y(k - 1) 
'+ S x (k)S y (k). 


(2.4-2) 


The basic block diagram showing the direct product, in PCM 
format [p D (k)j and in DM format [e (k)], is given in Fig. 
(2.4-1). Although the structure for the direct product is 
universal for any digital DM definable by Eqs . (2.1-1). 
through (2.1-3), it will be useful only if the step size 
algorithm is such that. we can recursively realize the 
particle products, that is, the last three terms in Eq. 
(2.4-2) . 




Fig. 2.4-1. Direct Product of DM 






REPRODUCIBILITY OF THE 
ORIGINAL PAGE IS POOR 

For the linear DM, no difficulty arises and the direct 
product is 


P D 0O = p D (k - 1) + Se y (k - l)x(k - 1) + Se x (k - l)y(k - 1) 


+ S 2 e x (k - l)-e (k - 1) . 


(2.4-3) 


The realization of this system, shown in Fig. (2.4-2);, is 
extremely easy because there are no non'-linear operations , 
only simple scaling including multiplication by +1 or -1. 

To derive the recursive relationships for the partial 
products with the Song audio mode algorithm, we must use a 
step size relationship common to all types of DMs , that is. 


S x (k) = |S x (k) |e x (k - 1) . 


(2.4-4) 


This equation says that the sign of the present step size, 

S„(k), is dictated by the past DM output bit, e x (k - 1) . 

From Eq. (2.1-6), we see that this property is applicable 

for the Song audio mode as long as js x (k - 1) j >_ S . If 

S (k - 1) = 0 and e v (k - 1) = e Y (k - 2) ,, then this property 
x x , A 

is also valid. Only when S x (k - 1) =0 and e x (k - 1) f 
e (k - 2) , the step size relationship becomes invalid. This 

X 

invalidity is caused' by a hardware limitation that allows 
the step size to be zero rather than an arbitrarily small 
value. We shall show,- however, that the condition of 
invalidity has a very low probability o'f occurrence and the 
resulting signal' estimate used in' the multiplication algo- 
rithm does not substantially degrade the product. 
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Equation (2.4-4) can only be invalid when S x (’k) = 0. 

.A .zero step size occurs primarily when -the ADM is in its 
minimum steady. state pattern. That is, the estimate resem- 
bles Fig. 2.3-1 when- m = 0. This corresponds to the audio 
signal being zero because, in speech, 50% of the time there 
is no voice. Recently, step size statistics have been ob- 
-tained for the Song audio mode ADM, using actual speech sig- 
nals. They show that the -probability of a zero step size is 
approximately 0.04 when f s = 32K bits/second . Since S x (k) 

= 0 occurs twice in a minimum steady state estimate pattern, 
the probability of such a pattern is 0.08. Let us assume 
that the audio signal is equally likely to increase or de- 
crease from its zero, value . in any of the four periods of the 
-steady state pattern. Only 2 of the 8 signal variations 
give rise to the condition when.Eq. (2.4-4) will be invalid. 
Therefore, the probability of invalidity is 0.02. 

We have created a situation in Fig,. 2.4-3 where the 
step size relationship is invalid. The -solid curve repre- 
sents the true ADM, estimate- and the broken line waveform is 
the estimate used in the multiplication algorithm. From 
this figure, we observe that the estimate used in the multi- 
plication algorithm is' just as good an approximation to the 
audio signal as the' true estimate. We shall see, in Sec.- 
2.8.3, that -the use of Eq. (2.4-2) does not noticeably ef- 
fect the output SNR of the DM multiplier. 

Now that we have justified the step size relationship, 
we can use it to express recursively the partial products 




Fig. 2.4-3. Example when the Step Size Relationship is Invalid 
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for the Song audio mode: 

S y (k)x(k - 1) = S y (k - l)x(k - 2 ) e y (k -l)e y .(k - 2) 

+ S x <k - l)S y (k - 1) e y (k - l)e y (k - 2) (2.4-5) 

+ x(k - l)Se (k - 2) , ■ 

- S x (k)y(k - 1) = S x (k - 1) y (k - 2)e x (k - l)e x (k - 2) 

+ S y (k - l)S x (k - l)e x (k - l')e x (k - 2) (2.4-6)' 

+ Y (k - l)Se x (k - 2) , 

S x (k)S y (k) = |s x (k - l)S y (k - 1) | e x (k - 1) e y (k - 1) 

+ S|S x (k - 1) |e x (k l)e y (k - 2) 

(2.4-7) 

+ S | S y (k - 1) | e y (k - l)e x (k - 2) 

+ S 2 e x (k - 2)e y (k - 2) . ‘ 

Equations (2.4-5), (2.4-6) and (2.4-7) are readily realiz- 
able with standard digital hardware similar to the DM 
adder shown in Fig. 2.2-3. These three terms can be con- 
structed with nothing more complicated than adders, delays, 
hard-wired scalers and exclusive-OR gates to multiply by il 
and produce the absolute value. 

All of the design structures that we have derived are 
accumulator type systems. For both the adder (Sec. 2.3) and 
the multiplier (Sec. 2.4), for all DM modes, the present out- 
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put is equal to the past output plus additional terms. 

Thus , it is important to begin with the- correct initial 
condition for the past output, or else suffer a' constant 
offset error. It is convenient to start with both signals, 
x (t) and y(t) , at zero so that we can employ a zero initial • 
condition for the past output. 

As in the case of the direct sum, we expect the 'direct, 
product, since it is formulated as the product of the indi- 
vidual signal estimates, to exhibit a periodic pattern when 
responding to constant inputs. When using the Song audio 
mode algorithm, the direct product generates four possible • 
steady state waveforms. In Fig. 2.4-4, we show the general 
structure of a steady state waveform. The values of -Cj and 

C~ depend upon x and y and the amplitude of the steady 

q q 

state error pattern (x - x -and y - y ) , while d x and d 2 de- 

H U 

pend only on the latter of these two. .The numerical values 
of d 1 and d 2 can be entirely different, but they both have 
the same form, as can be seen by multiplying two steady 
state patterns together, that is. 


where 


and 


| d ± |- = L/4, 
i = 1 , ’ 2 , 

L = a positive integer 
L < 4M 2 + 4M + 1 


(2.4-8) 


where M is bounded in Eq. (2.3-4). 
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The arithmetic average of any four consecutive values 
of p^(k) always equals the product of the quantized values 
of the inputs plus a second-order term depending on S 2 . 

This warrants the use of the following four-term non-recur- 
sive filter after p D (k): 

P{k) = ±[p (k) + P D (k ~'l) + p D (k - 2) + p D (k - 3)3. (2.4-10) 

Applying Eq. (2.4-10) to the waveform shown in Fig. 2.4-3, 
we see that 

P(k) = x y + (d + d ) S 2 /2 (2.4-11) 

for all k, as long as p D (k) has reached the steady state. 

We have found, through computer simulations, that the fac- 
tor (d x + d 2 )/2 generally is no larger than 10 or 20. In a 
practical DM encoder with 10 bits of internal arithmetic 
and an amplitude range of V = 10 volts, the minimum step 
size, S, will be approximately 10 millivolts. Therefore, 
the second-order term will be in the order of 1-2 millivolts . 

Even if we allow (d +'d )/2 to be 100, the error only 

1 2 

reaches 10 millivolts or one minimum step size. Certainly, 

one step size out of 1024 can be considered insignificant. 

For any reasonably small value of step size, the second 

order term, (d + d )S 2 /2, is negligible and thus, after 
1 2 

the four-term averaging filter, the DM product yields a re- 
sult almost identical to the PCM product. 

The direct DM product design structure that we have 
derived is not a unique solution to this problem. The de- 
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sign presented does, however, perforin well and this will be 
seen from the simulation responses for elementary input 
waveforms and also from the SNR performance curves. There 
are other design techniques that could have been incorpora- 
ted into the direct product design. We could introduce a . 
"leak" factor- in Eq. (2.4-2) and feedback a fraction of the 
output, p D (k), to generate, say 0.9p D (k - 1). Alternately, 
we might use a different averaging filter after p Q (k); or 
we could perform some kind of averaging on x(k) and y(k) be- 
fore we form their product. Each of these ideas would have 
to be analyzed individually to determine its merits and 
shortcomings - in formulating the direct DM product. 

2.5 Hardware Complexity 

From Eq. (2.2-2) or Fig. 2.2-1 we see that the complex- 
ity and quantity of the hardware needed for a DM adder is 
essentially equivalent to that needed for a PCM adder. In 
PCM addition, since we have two K-bit words coming from 
x(t) and y(t), we require .two K-bit input storage registers, 
one K-bit full adder and, since we do- not allow overflow, 
one K-bit output register . To obtain the DM direct sum, we 
need the step size circuitry for both signals (some of which 
can be time shared) terminating in registers with less than 
K-bit capacity, one transfer register with enough bits to 
represent twice the maximum step size, one K-bit full adder 
and one K-bit delay register. • . - 

The -comparison of hardware complexity for multiplica— 
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tion is somewhat more involved. PCM multiplication is gen- 
erally treated as a static operation where two K-bit words 
are either fed into a combinatorial circuit, or into a pre- 
programmed ROM, or into a repeating add-store-and-shif t cir- 
cuit. We must also remember that to multiply two signals, 
bandlimited to f , we must perform this static operation on 
the PCM words' from the two signals at a rate of 4f since 
the product will be bandlimited to 2f m . 

Now we can examine the hardware complexity needed for 
these PCM multipliers. A combinatorial circuit needs two 
K-bit input storage registers, K 2 AND gates, K K-bit full 
adders and a 2K-bit output storage register. This is 
easily seen by observing the structure that arises when we 
use "long" multiplication to obtain the product of two K-bit 
words, A •••A A and B„*“B B . A ROM, with a 2K-bit input 

j\ 2 1 2 1 

•address, normally has 2 2k memory locations. Even though 
there are only K 2 different product values, the ROM must 
• still use 2 2K memory locations to multiply as well as need- 
ing input and output registers. The repeating add-store- 
and-shift device requires two K-bit input registers, a K-bit 
shift register, K AND gates, a 2K-bit full adder and a 
2K-bit output register. However, for this last multiplier, 
we must perform K repeated additions in the time interval 
1/4 f m before we obtain the final product word. 

Considering the DM multiplier for the linear mode, as 
shown in Fig. 2.4-2, the hardware needed is. two 2-bit shift 
registers , two accumulators {each having a K-bit full adder 
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and then evaluate the performance. Since the inputs are 
statistically independent, the product signal power is 

p 2 = u 2 a 2 . (2.6-24) 

For PCM signals, the sample value and the error are. likewise 
statistically independent. Consequently, 

e p = 0 (2 . 6~25a) 

and 

Var(Sp) = e p = x 2 s 2 + y 2 e* • . (2.6-25b) 

Evaluating the variance of the product error , we obtain 

Var (e ) = (a 2 + a 2 )S 2 /12 + S 4 /L44 . (2.6-26) 

Thus, for the product of PCM encoded signals, 

SNR (PCM) = 144q x CTy . (2.6-27) 

P 12 (a* + aJ)S z + S 4 

If the two signals have equal power and the step size is 
small (a£ = = a 2 » S 2 ), the SNR becomes 

SNR (PCM) a 6 a 2 /S 2 . (2.6-28) 

r 

For the direct product of DM encoded signals, we can 
similarly develop an expression for the SNR. Again, we in- 
clude the averaging filter introduced in Eq. (2.4-10) and 
the DM error is formulated as 


h = P p 




(2.6-29) 
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where 

P = P (k) = XgYg + 6S 2 . ' (2.6-30) 

Here we have assumed that p^(k) has reached steady state and 
6 represents the- constant, (d : + d 2 )/2, introduced previ- 
ously. With the aid of-Eqs. (2.6-19) and (2.6-20-)-/ we find 
that _ . 

r = e _ + <SS 2 . • (2.6-31) 

Let us define the product SNR for DM signals to be . 

SNR (DM) = ,e~ ^r . ' (2.6-32) 

p Var(Cp) 

To calculate SNR p ( DM ) , we must evaluate 

^ p =6S 2 -, ' (2 . 6-33a) 

' F 2 " = eF~ + <5 2 S 4 (-2 . 6-33b) 

P P 

and 

Var(? p ) = “ ?p 2 = £p • (2.6-33c) 

But Eq. (2.6-33c) implies that 

Var(£p) = Var(£p) (2.6-33d) 

and 

SNRp(DM) = SNR p {PCM) . (2.6-34) 

Therefore , 

SNR (DM) = 6a 2 /S 2 

ir 


r 


(2.6-35) 
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racy .of' the product, while, at the same time, increasing the 
complexity of the hardware. 


2.6 SNR with Constant Inputs 

Consider 'first the SNR obtained by adding two statis- 
tically independent constant signals, such as x and y, that 
are PCM encoded. Defining the quantized samples as and 
y , and the respective errors as e x and e v , the PCM sum is 
seen to be 


a q = x q + V 

where 


and 



( 2 . 6 - 1 ). 


( 2 . 6 - 2 ) 



(2.6-3) 


We can also express the PCM sum as 

a = a - e , 
q a 

where the tr.ue sum is 

a = x + y 


(2.6-4) 


(2.6-5) 


and the sum error is 


s = e + e . 
a x y 


( 2 . 6 - 6 ) 


If the minimum step size, S, is the distance between PCM 
levels and it is sufficiently small, then e x and will be 
equally likely in the interval [-S/2 , S/2], One can readily 
show [16] that 
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(2 . 6-7a) 
(2 . 6-7b) 

where the bar in the above equations denotes the probabalis-' 
-tic expected value. 

Let us now .define the sum SNR for PCM signals to be 

SNR (PCM) = ILL , (2.6-8) 

a Var 

a 

where 

Var(a) = (a - a) 2 = a 2 - a 2 . (2.6-9) 

Assuming x and y to be independent, zero mean, Gaussian ran- 
dom variables with variances and c^., the variance- of the 
sum is 

I 7 *» 4 + a y * (2.6-10) 

To determine the variance of the sum error, Var(s ) , we note 

a. 

that 

e . = 0 , (2.6 — 11a) 

a 

so that 

V ar ( £ ) = T 2 * = 7 * + 7 1 = S 2 /6 . (2. 6 -lib-) 

a a x y 

Thus,, for PCM encoded signals, 

SNR (PCM) = 6 (cj 2 + a 2 )/S ? . 
a x y 



and 

4 = 4 = sZ/12 ' 


(2 . 6-12a) 
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Setting a ^ = a 2 = a 2 , Eg. (2..6-12a) becomes 


SNR (PCM) = 12cr 2 /S 2 (2.6-12b) 

a 

For the direct sum of DM. encoded signals, an analysis 
similar to the PCM case can be conducted by evaluating the 
difference between a and a D * However, the actual error 
that we are concerned with is after the' non-recursive four- 
term averaging- filter introduced in Eq. (2.3-6). This 
error is 

£ = a - A , (2.6-13) 

where 

A . = A (k) = x q .+ y q , (2.6-14) 

as obtained in Eq,. (2.3-7) when a (k) has reached steady 

D 

state. With the help .of Eqs . (2.6-1) and (2.6-4), we see' 
that 


K = e , (2.6-15) 

A a 

that is, the DM sum error after. the averaging filter is 
exactly the same as the PCM sum error. 

Defining the sum- SNR for DM signals "to be- 


SNR (DM) 
9 


Var (£ a ) ' 


(2.6-16) 


it is apparent that 

SNR (DM) = SNR (PCM) . 
a a • 


(2.6-17) 



40 

REPRODUCIBILITY OF THE 
ORIGINAL PAGE IS POOR 

Consequently, 

SNR (DM) = 12cf 2 /S 2 , (2.6-18) 

a 

where we have assumed that both x and y possess, the same 
signal power, a 2 . The conclusion, is that, for the case of 
constant input signals, the performance of the direct' DM ■ 
adder followed, by the averaging filter is identical to the 
PCM adder performance when the comparison is based on SNR. 

Now we shall consider the SNR obtained by multiplying 
two constant, statistically independent signals that are PCM 
encoded. Using the same notation as in the sum analysis, 
the PCM product is 

p = x 'y (2.6 -19 ) ' 

<3 q q 

Expressing the PCM product as 


p = p - e , (2 . 6-20) 

*q P • 

and using the defining relationships for x^ and y g in Eq. . 
(2.6-19), we see that the true product is 

p = xy (2.6-21) 


and the product error is 


e p = xe y + ye x - e x e y . 


( 2 . 6 - 22 ) 


We can specify the product SNR for PCM signals as 


' SNR P (PCM) = dbp- 

ir 


/ 


(2.6-23) 
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and then evaluate the performance. Since the inputs are 
statistically independent, the product signal power is 

p 2 = u 2 a 2 . (2.6-24) 

For PCM signals, the sample value and the error are. likewise 
statistically independent. Consequently, 

e p = 0 (2 . 6~25a) 

and 

Var(Sp) = e p = x 2 s 2 + y 2 e* • . (2.6-25b) 

Evaluating the variance of the product error , we obtain 

Var (e ) = (a 2 + a 2 )S 2 /12 + S 4 /L44 . (2.6-26) 

Thus, for the product of PCM encoded signals, 

SNR (PCM) = 144q x CTy . (2.6-27) 

P 12 (a* + aJ)S z + S 4 

If the two signals have equal power and the step size is 
small (a£ = = a 2 » S 2 ), the SNR becomes 

SNR (PCM) a 6 a 2 /S 2 . (2.6-28) 

r 

For the direct product of DM encoded signals, we can 
similarly develop an expression for the SNR. Again, we in- 
clude the averaging filter introduced in Eq. (2.4-10) and 
the DM error is formulated as 


h = P p 




(2.6-29) 
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performance comparison with PCM. There are other ways to 
obtain the product in PCM form by using the samples of both 
signals at a rate of 2f . This matter is further pursued 

in App . 2 . 

• < 

The problem that we consider here is the formation- of 
the product of x(t) and y{t) when we only have their DM se- 
quences, {e x (k}} and {.e y (k)}, available. Once again we re- 
strict ourselves to a design structure that can be imple- 
mented with standard digital hardware. Forming the direct 
product as the product of the individual signal estimates, 
we have 


P D <k) = x (k)y (k) . (2.4-1) 

As in the case of the direct sum, we can develop a recursive 
relationship as follows: 


P D 0O = p D (k - 1) + S y (k)x(k - 1) + S x (k)y(k - 1) 
'+ S x (k)S y (k). 


(2.4-2) 


The basic block diagram showing the direct product, in PCM 
format [p D (k)j and in DM format [e (k)], is given in Fig. 
(2.4-1). Although the structure for the direct product is 
universal for any digital DM definable by Eqs . (2.1-1). 
through (2.1-3), it will be useful only if the step size 
algorithm is such that. we can recursively realize the 
particle products, that is, the last three terms in Eq. 
(2.4-2) . 




Fig. 2.4-1. Direct Product of DM 






REPRODUCIBILITY OF THE 
ORIGINAL PAGE IS POOR 

For the linear DM, no difficulty arises and the direct 
product is 


P D 0O = p D (k - 1) + Se y (k - l)x(k - 1) + Se x (k - l)y(k - 1) 


+ S 2 e x (k - l)-e (k - 1) . 


(2.4-3) 


The realization of this system, shown in Fig. (2.4-2);, is 
extremely easy because there are no non'-linear operations , 
only simple scaling including multiplication by +1 or -1. 

To derive the recursive relationships for the partial 
products with the Song audio mode algorithm, we must use a 
step size relationship common to all types of DMs , that is. 


S x (k) = |S x (k) |e x (k - 1) . 


(2.4-4) 


This equation says that the sign of the present step size, 

S„(k), is dictated by the past DM output bit, e x (k - 1) . 

From Eq. (2.1-6), we see that this property is applicable 

for the Song audio mode as long as js x (k - 1) j >_ S . If 

S (k - 1) = 0 and e v (k - 1) = e Y (k - 2) ,, then this property 
x x , A 

is also valid. Only when S x (k - 1) =0 and e x (k - 1) f 
e (k - 2) , the step size relationship becomes invalid. This 

X 

invalidity is caused' by a hardware limitation that allows 
the step size to be zero rather than an arbitrarily small 
value. We shall show,- however, that the condition of 
invalidity has a very low probability o'f occurrence and the 
resulting signal' estimate used in' the multiplication algo- 
rithm does not substantially degrade the product. 
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Equation (2.4-4) can only be invalid when S x (’k) = 0. 

.A .zero step size occurs primarily when -the ADM is in its 
minimum steady. state pattern. That is, the estimate resem- 
bles Fig. 2.3-1 when- m = 0. This corresponds to the audio 
signal being zero because, in speech, 50% of the time there 
is no voice. Recently, step size statistics have been ob- 
-tained for the Song audio mode ADM, using actual speech sig- 
nals. They show that the -probability of a zero step size is 
approximately 0.04 when f s = 32K bits/second . Since S x (k) 

= 0 occurs twice in a minimum steady state estimate pattern, 
the probability of such a pattern is 0.08. Let us assume 
that the audio signal is equally likely to increase or de- 
crease from its zero, value . in any of the four periods of the 
-steady state pattern. Only 2 of the 8 signal variations 
give rise to the condition when.Eq. (2.4-4) will be invalid. 
Therefore, the probability of invalidity is 0.02. 

We have created a situation in Fig,. 2.4-3 where the 
step size relationship is invalid. The -solid curve repre- 
sents the true ADM, estimate- and the broken line waveform is 
the estimate used in the multiplication algorithm. From 
this figure, we observe that the estimate used in the multi- 
plication algorithm is' just as good an approximation to the 
audio signal as the' true estimate. We shall see, in Sec.- 
2.8.3, that -the use of Eq. (2.4-2) does not noticeably ef- 
fect the output SNR of the DM multiplier. 

Now that we have justified the step size relationship, 
we can use it to express recursively the partial products 




Fig. 2.4-3. Example when the Step Size Relationship is Invalid 
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for the Song audio mode: 

S y (k)x(k - 1) = S y (k - l)x(k - 2 ) e y (k -l)e y .(k - 2) 

+ S x <k - l)S y (k - 1) e y (k - l)e y (k - 2) (2.4-5) 

+ x(k - l)Se (k - 2) , ■ 

- S x (k)y(k - 1) = S x (k - 1) y (k - 2)e x (k - l)e x (k - 2) 

+ S y (k - l)S x (k - l)e x (k - l')e x (k - 2) (2.4-6)' 

+ Y (k - l)Se x (k - 2) , 

S x (k)S y (k) = |s x (k - l)S y (k - 1) | e x (k - 1) e y (k - 1) 

+ S|S x (k - 1) |e x (k l)e y (k - 2) 

(2.4-7) 

+ S | S y (k - 1) | e y (k - l)e x (k - 2) 

+ S 2 e x (k - 2)e y (k - 2) . ‘ 

Equations (2.4-5), (2.4-6) and (2.4-7) are readily realiz- 
able with standard digital hardware similar to the DM 
adder shown in Fig. 2.2-3. These three terms can be con- 
structed with nothing more complicated than adders, delays, 
hard-wired scalers and exclusive-OR gates to multiply by il 
and produce the absolute value. 

All of the design structures that we have derived are 
accumulator type systems. For both the adder (Sec. 2.3) and 
the multiplier (Sec. 2.4), for all DM modes, the present out- 
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put is equal to the past output plus additional terms. 

Thus , it is important to begin with the- correct initial 
condition for the past output, or else suffer a' constant 
offset error. It is convenient to start with both signals, 
x (t) and y(t) , at zero so that we can employ a zero initial • 
condition for the past output. 

As in the case of the direct sum, we expect the 'direct, 
product, since it is formulated as the product of the indi- 
vidual signal estimates, to exhibit a periodic pattern when 
responding to constant inputs. When using the Song audio 
mode algorithm, the direct product generates four possible • 
steady state waveforms. In Fig. 2.4-4, we show the general 
structure of a steady state waveform. The values of -Cj and 

C~ depend upon x and y and the amplitude of the steady 

q q 

state error pattern (x - x -and y - y ) , while d x and d 2 de- 

H U 

pend only on the latter of these two. .The numerical values 
of d 1 and d 2 can be entirely different, but they both have 
the same form, as can be seen by multiplying two steady 
state patterns together, that is. 


where 


and 


| d ± |- = L/4, 
i = 1 , ’ 2 , 

L = a positive integer 
L < 4M 2 + 4M + 1 


(2.4-8) 


where M is bounded in Eq. (2.3-4). 
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The arithmetic average of any four consecutive values 
of p^(k) always equals the product of the quantized values 
of the inputs plus a second-order term depending on S 2 . 

This warrants the use of the following four-term non-recur- 
sive filter after p D (k): 

P{k) = ±[p (k) + P D (k ~'l) + p D (k - 2) + p D (k - 3)3. (2.4-10) 

Applying Eq. (2.4-10) to the waveform shown in Fig. 2.4-3, 
we see that 

P(k) = x y + (d + d ) S 2 /2 (2.4-11) 

for all k, as long as p D (k) has reached the steady state. 

We have found, through computer simulations, that the fac- 
tor (d x + d 2 )/2 generally is no larger than 10 or 20. In a 
practical DM encoder with 10 bits of internal arithmetic 
and an amplitude range of V = 10 volts, the minimum step 
size, S, will be approximately 10 millivolts. Therefore, 
the second-order term will be in the order of 1-2 millivolts . 

Even if we allow (d +'d )/2 to be 100, the error only 

1 2 

reaches 10 millivolts or one minimum step size. Certainly, 

one step size out of 1024 can be considered insignificant. 

For any reasonably small value of step size, the second 

order term, (d + d )S 2 /2, is negligible and thus, after 
1 2 

the four-term averaging filter, the DM product yields a re- 
sult almost identical to the PCM product. 

The direct DM product design structure that we have 
derived is not a unique solution to this problem. The de- 
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sign presented does, however, perforin well and this will be 
seen from the simulation responses for elementary input 
waveforms and also from the SNR performance curves. There 
are other design techniques that could have been incorpora- 
ted into the direct product design. We could introduce a . 
"leak" factor- in Eq. (2.4-2) and feedback a fraction of the 
output, p D (k), to generate, say 0.9p D (k - 1). Alternately, 
we might use a different averaging filter after p Q (k); or 
we could perform some kind of averaging on x(k) and y(k) be- 
fore we form their product. Each of these ideas would have 
to be analyzed individually to determine its merits and 
shortcomings - in formulating the direct DM product. 

2.5 Hardware Complexity 

From Eq. (2.2-2) or Fig. 2.2-1 we see that the complex- 
ity and quantity of the hardware needed for a DM adder is 
essentially equivalent to that needed for a PCM adder. In 
PCM addition, since we have two K-bit words coming from 
x(t) and y(t), we require .two K-bit input storage registers, 
one K-bit full adder and, since we do- not allow overflow, 
one K-bit output register . To obtain the DM direct sum, we 
need the step size circuitry for both signals (some of which 
can be time shared) terminating in registers with less than 
K-bit capacity, one transfer register with enough bits to 
represent twice the maximum step size, one K-bit full adder 
and one K-bit delay register. • . - 

The -comparison of hardware complexity for multiplica— 
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tion is somewhat more involved. PCM multiplication is gen- 
erally treated as a static operation where two K-bit words 
are either fed into a combinatorial circuit, or into a pre- 
programmed ROM, or into a repeating add-store-and-shif t cir- 
cuit. We must also remember that to multiply two signals, 
bandlimited to f , we must perform this static operation on 
the PCM words' from the two signals at a rate of 4f since 
the product will be bandlimited to 2f m . 

Now we can examine the hardware complexity needed for 
these PCM multipliers. A combinatorial circuit needs two 
K-bit input storage registers, K 2 AND gates, K K-bit full 
adders and a 2K-bit output storage register. This is 
easily seen by observing the structure that arises when we 
use "long" multiplication to obtain the product of two K-bit 
words, A •••A A and B„*“B B . A ROM, with a 2K-bit input 

j\ 2 1 2 1 

•address, normally has 2 2k memory locations. Even though 
there are only K 2 different product values, the ROM must 
• still use 2 2K memory locations to multiply as well as need- 
ing input and output registers. The repeating add-store- 
and-shift device requires two K-bit input registers, a K-bit 
shift register, K AND gates, a 2K-bit full adder and a 
2K-bit output register. However, for this last multiplier, 
we must perform K repeated additions in the time interval 
1/4 f m before we obtain the final product word. 

Considering the DM multiplier for the linear mode, as 
shown in Fig. 2.4-2, the hardware needed is. two 2-bit shift 
registers , two accumulators {each having a K-bit full adder 
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and then evaluate the performance. Since the inputs are 
statistically independent, the product signal power is 

p 2 = u 2 a 2 . (2.6-24) 

For PCM signals, the sample value and the error are. likewise 
statistically independent. Consequently, 

e p = 0 (2 . 6~25a) 

and 

Var(Sp) = e p = x 2 s 2 + y 2 e* • . (2.6-25b) 

Evaluating the variance of the product error , we obtain 

Var (e ) = (a 2 + a 2 )S 2 /12 + S 4 /L44 . (2.6-26) 

Thus, for the product of PCM encoded signals, 

SNR (PCM) = 144q x CTy . (2.6-27) 

P 12 (a* + aJ)S z + S 4 

If the two signals have equal power and the step size is 
small (a£ = = a 2 » S 2 ), the SNR becomes 

SNR (PCM) a 6 a 2 /S 2 . (2.6-28) 

r 

For the direct product of DM encoded signals, we can 
similarly develop an expression for the SNR. Again, we in- 
clude the averaging filter introduced in Eq. (2.4-10) and 
the DM error is formulated as 


h = P p 




(2.6-29) 
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where 

P = P (k) = XgYg + 6S 2 . ' (2.6-30) 

Here we have assumed that p^(k) has reached steady state and 
6 represents the- constant, (d : + d 2 )/2, introduced previ- 
ously. With the aid of-Eqs. (2.6-19) and (2.6-20-)-/ we find 
that _ . 

r = e _ + <SS 2 . • (2.6-31) 

Let us define the product SNR for DM signals to be . 

SNR (DM) = ,e~ ^r . ' (2.6-32) 

p Var(Cp) 

To calculate SNR p ( DM ) , we must evaluate 

^ p =6S 2 -, ' (2 . 6-33a) 

' F 2 " = eF~ + <5 2 S 4 (-2 . 6-33b) 

P P 

and 

Var(? p ) = “ ?p 2 = £p • (2.6-33c) 

But Eq. (2.6-33c) implies that 

Var(£p) = Var(£p) (2.6-33d) 

and 

SNRp(DM) = SNR p {PCM) . (2.6-34) 

Therefore , 

SNR (DM) = 6a 2 /S 2 

ir 


r 


(2.6-35) 
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where 

P = P (k) = XgYg + 6S 2 . ' (2.6-30) 

Here we have assumed that p^(k) has reached steady state and 
6 represents the- constant, (d : + d 2 )/2, introduced previ- 
ously. With the aid of-Eqs. (2.6-19) and (2.6-20-)-/ we find 
that _ . 

r = e _ + <SS 2 . • (2.6-31) 

Let us define the product SNR for DM signals to be . 

SNR (DM) = ,e~ ^r . ' (2.6-32) 

p Var(Cp) 

To calculate SNR p ( DM ) , we must evaluate 

^ p =6S 2 -, ' (2 . 6-33a) 

' F 2 " = eF~ + <5 2 S 4 (-2 . 6-33b) 

P P 

and 

Var(? p ) = “ ?p 2 = £p • (2.6-33c) 

But Eq. (2.6-33c) implies that 

Var(£p) = Var(£p) (2.6-33d) 

and 

SNRp(DM) = SNR p {PCM) . (2.6-34) 

Therefore , 

SNR (DM) = 6a 2 /S 2 

ir 


r 


(2.6-35) 



43 


where we have again allowed the two signals to have equal 
power (a 2 ) and taken a 2 >> S 2 . 'As in the case of addition, 
we conclude that, based upon SNR, the performance of the 
direct DM multiplier followed by the averaging . filter is 
identical to the PCM multiplier performance when dealing 
with constant input signals . • 

2 . 7 Simulation Results with Elementary Signals 

The direct arithmetic' processors that have been de- 
signed exhibit some very encouraging characteristics. They 
are readily physically realizable without an excessive 
amount of hardware complexity and,, with the averaging fil- 
ter, the SNRs for constant inputs is the same as obtained 
with PCM processors. To 'determine the response to a set 
of- elementary input signals, we simulated the direct DM 
adder and multiplier on a digital computer. In these simu- 
lations, we used the Song audio mode algorithm and thus had 
to realize the circuit shown in Fig. 2.2-3 for the adder.. 

The DM multiplier was constructed from Eqs .- (2.4-2), (2.4-5), 

(2.4-6) and (2.4-7). We also had to simulate two DM en- 
coders in order to generate the bit streams {e x (k)} and 
{e y (k)}. 

All the simulations were performed on a PDP 8/L compu- 
ter with 8K bytes of memory. First, the DM encoders were 
constructed and it was confirmed that the estimate varied 
according to the Song audio mode algorithm, i.e., Eq. 

(2.1-6). Likewise, it was verified that the steady state 
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estimate to a constant input took the form shown in Fig. 

2.3- 1. Then we simulated the system for the direct sum fol- 
lowed by the averaging filter defined by. Eq. (2.3-6). Ini- 
tial tests were performed on the direct adder with step in- 
puts, pulse inputs and sinusoidal signals. 

In all simulation results, the step size and the samp- 
ling period are normalized to unity. Figure 2.7-1 shows the 
'sum of a step function and a pulse; Fig. 2.7—2, displays the 
result of .adding a step function and a sinusoid; and Fig. 

2.7- 3 gives the addition of two in-phase sinusoids with the 
same amplitudes and frequencies . In all cases we have in- 
cluded the actual sum, shifted to account for the proces- 
sor's delay. With the actual sum, we can visually evaluate 
these initial tests. 

Next, the direct DM’ product system, again followed by 
the four-term averaging filter, was successfully simulated. 
We confirmed that the steady state direct product with con- 
stant inputs did, in fact, take the form shown in Fig. 

2.4- 3. As in the case of the direct sum, we used the same 
set of elementary signals in our initial tests. In Fig. 

2.7- 4, we show the product of a step function and a pulse. 

In Fig. 2.7-5, we display the result of multiplying a step 

•function and a sinusoid. In Fig. 2.7-6, we give the multi- 
plication of two in-phase sinusoids with the same amplitudes 
and frequencies. Again, we include the actual product de- 
layed to facilitate the evaluation of the direct DM product. 
All of these simulation -results verify the theory, de- 
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veloped for both the DM direct sum and. the DM direct product. 
We must emphasize the role played by the four-term averaging 
filter to achieve both sum and product results that are so 
accurate. To fully appreciate the effect of this four-term 
averaging, we show in Fig. 2;7-7 the direct product of a 
step and a pulse without the four-term averaging. Compar- 
ing this with Fig. 2.7-4, which is the result -after four- 
.term averaging, clearly demonstrates the important role 
played by this filter. 

As a concluding remark, we observe an important charac- 
teristic of the DM multiplier. In Fig. 2.7-8, we show the 
response of a Song audio mode DM to a step of amplitude 150. 
The response time, needed to reach 150, is at least 17 samp- 
ling periods. Notice, from Fig. 2.7-4, that for the multi- 
plier to reach an amplitude of 150 it takes only 8 sampling' 
periods. Thus, we have expanded the bandwidth by a factor 
of two, consistent with the previous assumption .of the mul- 
tiplication process. 

2 . 8 Performance Evaluation 

The simulation results presented above offer a suffi- 
ciently good qualitative evaluation of the operation of the 
DM adder and multiplier. However , we also would like to 
obtain a quantitative figure of merit which will allow easy 
comparison with other digital processing systems. Since we 
have confined ourselves to a DM audio mode algorithm, we 
shall apply an evaluation criterion commonly used for 
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Fig. 2.7-7. DM Product of a Step and a Pulse without Four-Term Averaging Filter 
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speech waveforms . 

Voice signals generally occupy a bandwidth of approxi- 
mately 2500-3000 Hz, starting about 200-300 Hz and having 
most of their energy in the area of 600-800 Hz. A voice 
system is often tested by using a single tone of frequency 
600-800 Hz as the input and measuring the output SNR after 
a LPF which cutsoff at about four times the tone frequency. 

We have developed a technique to simulate this type of eval- 
uation test on a digital computer and have generated a 
family of SNR curves for both the DM adder and the DM 
multiplier. 

2.8.1 Fourier Series Representation of the DM Estimate 

First, we shall develop the theory needed to calculate 
the output SNR for the simple case of a DM encoder. Then 
we shall show that it will be a natural extension to apply 
this theory to the DM processors. 

Let x(t), the input to a DM encoder, be a sinusoid of 
frequency f Q and let the DM bit rate be 

f = Pf . ' (2.8-1) 

s o ' 

where P is a positive integer greater than one. Whenever 
the sampling frequency is an integer multiple of the sinu- 
soid frequency, the DM estimate, x(k), will assume a periodic 
sinusoidal steady state pattern which can be expressed as a 
Fourier series. The frequency components of this series 
can be calculated and low pass filtered. The resulting 
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filtered estimate then can be used to determine the output 
SNR. 

A much stronger statement of this concept can be made 
by not limiting x(t) to be a sinusoid, but only to be a 
periodic signal. If f s is now an -integral multiple of the 
fundamental frequency of the input, then we can always de- 
termine the spectral composition of the estimate. For our 
purposes, however, we need only be concerned with sinusoidal 
inputs . 

Consequently, the period of the estimate will be T Q , 

where 

T q = l/f Q , (2.8-2) 

of any integral multiple of T Q . For the sake of simplicity 
in deriving its Fourier series, let us assume that the fun- 
damental frequency of the estimate is f Q and not a submul- 
tiple of it. This means that x(k) periodically takes, on P 
discrete values, denoted as Xj.,. every T Q seconds. In this 
analysis, the estimate takes' the form of a staircase-like 
waveform and each discrete value., x j , lasts -for T Q /P seconds. 
Using the continuous notation, x(t), the Fourier series of 
the DM estimate can be expressed as 



(2. 8-3b) 
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and 


c n “ /A n + '4' 


<J> n = -arctan(B n /A n ) , 


A = (2/T )/ x (t) cos (2irnf t) dt , 
n o > ^ 


T °, 

B n - (2/T Q ) / x(t) sin (2irn£ 0 t) dt . 


(2.8-3c) 
(■2. 8-3d) 

(2 . 8-3e) 

(2. 8-3f ) 


Substituting the discrete values of x(t) we can re- 
write Eqs . (2..8-3e) and -(2.8-3f) as 


P jT 0 /P 

A = (2/T -) S x./ cos (27rnf t).dt (2. 8-4a) 

n ° j=l ] (j-l)T 0 /P 


P j T /P 

B ='(2/T ) S x./ ° sin(2Trnf t)dt . (2.8-4b) 

n ° j=l 3 (j-l)T o /P ' 


By invoking some trigonometric identities , we can further 

reduce A and B to a form which is readily adaptable for 
n n 

computer simulation, that is, 


P 

a = 2sin (nir/P) £ x -cos [nir (2 j - 1)/P3 (2.8-5a) 

■ htt -j =1 J 


B _ 2sin (mr/P) £ x.sin[niT(2j - 1)/P] 
n nir 3 


(2 . 8-5b) 
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Now we have available the strength of the Fourier components 
of the DM estimate, C , and thus" the essential information 
to evaluate the DM performance . Since we are ultimately 
concerned with the performance of the DM processors, it 
remains to extend this development to the DM sum and the 
DM product. 

Similar to the case when we considered the response of 
the DM' adder and multiplier to constant inputs, we need only 
refer to the basic initial design equations, i.e., Eq. 

(2.2-1) and Eq. (2.4-1). These tell us that the direct 
sum and product are formulated as the sum and product, re- 
spectively, of the individual signal estimates. Since we 
shall be adding or multiplying two periodic sinusoidal 
steady state patterns, a D (k) and p D (k) must also be periodic 
signals. Therefore, the Fourier series representation 
theory is immediately applicable to the DM direct sum and 
product . 

2.8.2 Output SNR 

To determine the desired figure of merit, we must go 
from the Fourier series of the DM estimate to the output 
SNR. Since we are concerned with an audio mode DM, it 
would seem reasonable to choose a low pass filter (LPF) ap- 
plicable to voice signals to bridge this gap. 'A LPF com- 
monly used in experimental work is a fourth-order Butterworth 
type whose magnitude -squared transfer function is given- as. 
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where 


|H B (s)l 2 = 1/[1 + (s/o) c ) 8 ] , (2.8-6) 

w c = the radian cutoff frequency. 


The. frequency characteristics of this LPF are: 


|H B (f) | 2 = l/ll + (f/f c ) 8 ] , (2.8-7) 

where 

f c = oj c /2tt . (2.8-8) 

To realistically represent a voice signal, we shall 
choose f Q = 800 Hz and f c = 4f Q = 3200 Hz. From Eq. (2.8-7) 
we can obtain the attenuation factor, a n , that we must scale 
the Fourier components of x(t) by to simulate low pass fil- 
tering. Using f = 4f Q , we find that 

_i 

a n = Cl + (n/4 ) 8 ] T . ■ (2.8-9) 

Since all harmonics are orthogonal, we shall be concerned 
only with the attenuation produced by the LPF and not con- 
sider the phase shift which arises. 

After final low pass filtering, the output signal power 
becomes 

S = I(a,C,) 2 . (2.8-10) 

O 2 1-1 

The output noise power comes from all the filtered frequency 
harmonics other than the fundamental. After the LPF, the 
output noise power is express able as 
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N = 7 Z (aC ) 2 . 
o z ' n *n ■ 


( 2 . 8 - 11 ) 


n=2 


Thus, the output signal-to-noise ratio (SNR q ) -is given as 


■ - s o • 

•SNR = -2- =* 

° N o 


(ajC,) 


£, < W 

n 


( 2 . 8 - 12 ) 


2.8.3 Performance Curves 

From our system simulations we verified that the DM 
estimate, the direct DM sum and the direct DM product all 
produced - periodic responses to- sinusoidal inputs when the 
DM bit. rate was an . integral multiple of the frequency of 
the sinusoid. By expanding the simulation programs we were 
able to incorporate the calculation of .the Fourier compo- 
nents of the various outputs. All the simulations, includ- 
ing calculation of output SNR, were carried out on the P.DP. 
8/L computer using the FOCAL system. FOCAL, an abbreviation 
for Formulating On-line Calculations in Algebraic Language, 
is a conversational programming language which is similar 
to, but riot as powerful as FORTRAN or BASIC. 

In determining SNR Q , we did not use an infinite number 
of harmonics to calculate the noise power as required, by 
Eq. (2.8-11). Instead, we truncated after the ninth har- 
monic since (a 10 C 10 ) 2 was negligible in comparison with- the 
noise due to the second through ninth harmonics. We have 
found that, for the same input signal power and for the same 
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ratio, f s /f Q / the periodic sinusoidal steady state pattern 
that the DM estimate assumes., and .consequently the SNR q , ere 
very dependent upon the starting point of the input sinu- 
soid. Since the input is zero before the sinusoid starts 
and the ADM estimate tracks the zero input with a periodic 
pattern of duration 4T s , the sinusoid can start ah any point 
within this interval with equal probability. The SNR Q has 
become a random variable dependent on the starting point of 
the input sine wave. , In Fig. 2.8-1, we show the ADM re- 
sponse to a constant input and a number of possible start- 
ing points of the- input sinusoid. To obtain a truly repre- 
sentative value of SNR q we employed 40 different starting 
points and calculated the mean and the standard deviation 
about the mean, a(SNR 0 ). 

We have generated several families of performance 
curves. In Fig. 2.8-2, we show the SNR in dB for the 
direct sum, SNR 0 , versus relative input signal power over 

a. 

a range of 54 dB for ratios of. f s /f Q = 60 , 40 and 20. This 
ratio is equivalent to the f s / R a = 7.. 5, 5 and' 2.5, where 
the variable R a is the PCM Nyquist rate for the sum. Thus, 

a. 

f /R is the number of bits in an equivalent PCM' system. 

The input signal power was varied by changing the amplitude 
of the input sinusoid. A relative input signal power of 
-6 .dB corresponds to an amplitude of 5S, where S is the min- 
imum step size, while 42 dB represents an amplitude of 1280S 

To obtain the performance curves for the direct product 
we let both .inputs equal the same sinusoid. Therefore, the 
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product becomes the square of the input signal. In this 
case, the output signal power comes from the product fre- 
quency, f = 2f Q , and the noise from all other harmonics. 

In Fig. 2.8-3, we give the SNR for the direct product, 

SNRp, as a function of relative input signal power over the 
same range of 54 dB with the parameter f s /f taking on 

- r 

values 30, 20 and 10. This parameter is the same as the 
ratio f /2R = 3.75, 2.5 and 1.25, where R is the PCM 

S p rr 

Nyquist rate for the product. We shall see that f s /2Rp 
is the number of input bits in ,an equivalent PCM multiplier. 
Since the output signal frequency is twice the input signal 
frequency, we naturally expect SNR to be less than the SNR 

IT 

from the DM sum because the DM is frequency sensitive. 

• Recall that the SNR is actually a random variable, as 
explained previously. Consequently, all the plots shown 
above were drawn as smooth curves through windows of one 
standard -deviation about the mean value of the SNR. On the 
SNR a family we show the set of windows for one curve. In 
lieu of the other standard deviation windows, we denote the 
range of the standard deviation for each curve in both the 
sum family and the product family. The significance of 
these performance curves will be detailed in the next sec- 
tion when we compare the DM systems to PCM processors. 

i 

2.9 Comparison with PCM Systems 

We shall compare the DM direct- processors with their 
dual PCM systems based on the SNR achieved with equivalent 
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channel bit. rates. To achieve a wide dynamic range, 
companded PCM is generally used Eor encoding speech signals. 
With an input sinusoid, the SNR for companded PCM is given 
as 


SNR (PCM) = 6N + 1.8 + I (a?) dB , (2.9-la) 

where 

N = the number of bits used' to PCM 
encode the input signal 

and 

I (a?) = the companding improvement- factor , 

1 a function of the input signal 
power . 


For logarithmic companding commonly used by the telephone 
company, a family of improvement curves is given which dis- 
plays I(cr?) as a function of signal power below full load 
sinusoid for several values of ' the compression factor, y 
[17]. A full load sinusoid has the maximum amplitude that 
can be encoded with N bits . 

If we choose a median value for the compression factor 
(y = 100), then, for a full load sinusoid, I - -9.5 dB. 
Thus, the maximum SNR for companded PCM with y = 100 is 


SNR (PCM) = 6N - 7.7 dB . (2. 9 -lb) 

m 

Since this compression factor yields a SNR curve which drops 
off only 3 dB from the maximum value over a dynamic range 
of 30 dB, Eq. (2.9-lb) will be our basis of comparison for 
companded PCM systems. 
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For the case of digital addition, 'for both PCM and DM, 
it does not matter if .we encode ,* process and transmit or 
encode, transmit and process. There -is no change in channel 
bit rate. This point will be critical when comparing multi- 
plication. To best explain the comparison with the PCM ad- 
dition system, we shall refer to the chart given in Table 
2.9-1.’ Consider the bandwidth of each input signal to be 
B Hz. The input signals are encoded into N-bit PCM and then 
processed. Since we are adding the two signals, the output 
bandwidth is also B Hz. The PCM sampling rate for the sum 
is 

R = 2B ', (2.9-2) 

a 

and the number of bits it will have, assuming no overflow, 
is 

N = N . (2.9-3) 

a 

Consequently , the PCM channel bit rate becomes 

R a N a = 2BN . (2.9-4) 

Since we use an input tone of frequency f Q in determining 
performance curves and set the output LPF to cutoff at 
4f we must equate the cutoff frequency to the output 
bandwidth, i.e., 

f = 4f G = B . (2.9-5) 

To compare the systems, we specify equivalent channel 




PERFORMANCE PARAMETERS 




FOR COMPARING DM. ENCODED a D (k) & p (k) 

TO N-BIT PCM' 


SUM 



PRODUCT 

Input Signal'- Bandwidth 

B 



B 

Output Signal Bandwidth 

B 



2B 

PCM Sampling Rate 

R = 2B 
a 



R p - 4B 

PCM Bits in Processor 

N a = N 


- 

N = 2N 

P • , ’ 

PCM Channel Rate 

2 BN 


. 

8BN 

Input Tone Frequency 

f o 



^o 

Output LPF Cutoff Frequency 

' . f c - 4f 0 » B 



CT 

CM 

il 

0 

"d* 

II 

o 

DM Sampling Rate 

'• f = 2BN = NR 
s a 



f g = 8BN = 2NR p 

DM SNR Index 

:■ V R a " H 



V 2R P = N 

DM Performance Curves 

f = 20f « 2.5R 

s-o a 


£ s 

= 20f o = 1.25 (2R p ) 

Sampling Rates 

f s - 40 f Q - 5R a 


f s 

= 40f o = 2.5 (2R ) 


f s “ 60f o = 7 * 5R a 


fs 

= 60f o -• 3.75(2R p ) 


TABLE 2.9-1. Comparison of DM and PCM Arithmetic Processors 
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bit rate. For the DM adder, the bit rate is''f g . Therefore, 

f = 2 BN = R N . (2.9-6)" 

s a. 

The DM SNR index used in Fig. 2. 8-2' is clearly the number 
of PCM bits used to encode the input signals, i.e., 

f /R — N . (2.9-7) 

s' a 

On the performance graph for the DM direct sum. Fig,. 
2.8-2, we have plotted the SNR for N-bit companded PCM, when 
N = 7.5 and 5. For these curves, we set the full load am- 
plitude equal to 512S, representing a DM system with 10 bits 
of internal arithmetic. In these two cases, the PCM and DM 
systems yield comparable performance. When N = 2.5, 
SNR m (PCM) = 7.3 dB in comparison with approximately 16 dB 
for the ADM adder. At low transmission rates, the DM sys- 
tem clearly has the advantage. 

When considering digital multiplication, it is very 
important to process first and then to transmit. If we re- 
verse this order, the DM bit rate will increase by a factor 
of two and the resulting performance will appear that much 
downgraded. As in the case of addition, we shall refer to 
Table 2.9-1 extensively in this comparison. Again, the 
input signals are bandlimited to B Hz and encoded into N-bit 
PCM signals . The PCM multiplication causes' the output sig- 
nal to have a bandwidth of 2B and consequently, the sampling 
rate for the product must be 
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Rp * 4B . (2.9-8) 

More important, the number of . bits needed for the product is 

N = 2N . (2.9-9) 

P • 

Thus , the channel bit rate is 

RpNp = 8BN . (2.9-10) 

Again, the frequency of the input tone is f and the 
LPF cutoff frequency is set to 4f Q . Equating the output 
bandwidth to the cutoff . frequency , we obtain 

f c = 4f 0 * 2B . (2.9-11) 

Now we can compare the systems on the basis of equal chan- 
nel bit rate. Since we are transmitting the DM encoded di- 
rect product the bit rate is still f . Therefore, 

f = 8 BN = 20 . (2.9-12) 

s P 

Now it is obvious that- the parameter employed in the DM 
product SNR graph is the number of bits used to PCM encode 
the input signals, that is, 

f /2R = N . (2.9-13) 

® Jr 

Comparing the performance curves shown in Fig. 2.8-3 with 
Eq. (2.9-lb), we find that the DM SNR is consistently 
higher. We must remember that because -'we have DM encoded 
P D (k) in this comparison system, we should really look at 
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the SNR curves of p D (k). But these curves are exactly the 
same as Fig. 2.8-3 except 1-2 dB lower. This is the same 
effect as experienced when placing DM links in tandem [18]. 

We have shown the feasibility of adding and multiplying 
DM encoded signals. The systems presented use only standard 
digital devices in their realizations and the performance 
curves do not show any surprising results . Comparing the 
DM processors to PCM systems for the same bit rate, we have 
shown that their performance is either comparable or better. 
Although the order of operation is unimportant when adding, 
it is vital to first process and then transmit when multi- 
plying. • 

As a concluding remark, we shall consider some practi- 
cal aspects of the DM' processors . The DM adder can be ap- 
plied when we need to mix voice channels , as in a stereo 
system. The DM multiplier can serve as . the basis for con- 
structing a correlator. Although we can realize only dis- 
crete time delays, they take the very simple form of one-bit 
shift registers, since we must merely delay e x (k). 

A final consideration is the measurement of output SNR. 
With ,a DM system that has to be physically constructed, the 
SNR will not be a random variable dependent on the starting 
point of the input sinusoid. Consequently, we will not mea- 
sure different values of SNR each time the device or the 
input is turned on. In a real system, we can never guaran- 
tee that.f g will be an exact integral multiple of f Q . In 
fact, the DM clock and an input ' sinusoid are actually non- 
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coherent signals. This noncoherence has been- modeled as 
different starting points , The measured output SNR is 
therefore analogous to the mean SNR with an infinite number 
of different initial conditions . 
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CHAPTER 3 , 

CONVERSION FROM ADM ENCODED SIGNALS TO PCM ENCODED 
SIGNALS USING DIGITAL FILTER TECHNIQUES 

Due to high quality performance and ease in implemen- 
tation, many modern communications systems are employing 
digital encoding techniques. Among- the existing digital 
encoding techniques, ADM and PCM are widely utilized in com- 
mercial communications. To facilitate digital processing 
of signals encoded in ADM and PCM formats , there is a need 
for translation units between the two systems. In this 
chapter, we consider conversion from ADM to PCM format. 

A general technique is presented’ for converting ADM 
encoded signals to PCM format without first demodulating the 
ADM bit stream and returning to the analog domain. The 
translation unit that is derived employs only standard digi- 
tal hardware, and is applicable to a large class of ADM en- 
coders. SNR curves are given for PCM converted, sinusoidal 
signals obtained from the three different systems which are 
presented in this chapter. Thus, we can present a relevant 
evaluation of the performance of these ADM to PCM converters. 

3.1 Basic ADM-PCM Conversion Philosophy 

Consider an analog signal, x(t) , assumed bandlimited 

to f , which has been ADM encoded at a rate f_. The general 
m' s 

form of the ADM was given in Fig. 2.1-1 and mathematically 



described by Eqs . (2.1-1) through (2.1-4). The only con- 

straint imposed upon this system is that the ADM bit rate is 
an integral multiple of the Nyquist rate, that is. 


where. 


and 



(3.1-1) 



(3.1-2) 


R = a positive integer greater than 1. 


In our conversion system, the value of R is set by f and 
we cannot vary this in our design. Since we are converting 
between two digital encoding systems , we restrict our design 
to an all-digital technique which can be implemented with 
standard digital hardware. 

The conversion from ADM to PCM encoded signals entails 
changing from a high "information" rate (ADM) to a lower 
one (PCM) . Formally stated, an ADM to PCM converter oper- 
ates on the sequence {e (k) } and produces x(t) in PCM -for- 

A 

mat. Examining the ADM in Fig. 2.1-1, we see that one of 
its basic equations is 


x(k) = x(k) + £x(k) , (3.1-3) 

where 

x(k) = the input signal, 
x(k) = the ADM estimate 

and 


£„(k) = the error signal. 

A 

Since the ADM is operating at a rate f s , the above notation 
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means that 


-x(k) = x(t = kT g ) , (3.1-4) 

where 

T g = l/f s . (3.1-5) 

Usually, x(k) is given and we find x(k). Now the- prob- 
lem is reversed: x(k) is given, via the. ADM bits, (e x (k) }',. 

and we want to find, x(t). To do this, we must estimate 

£ (k) . Then, to achieve PCM format, we must sample x(t) + 

X 

£ x (k) at a rate f N = f s /R. Consequently, the ADM to PCM 
converter should perform the function: 

x (Rk) = x (Rk) + ? x (Rk) , (3.1-6) 

where x(k) and E, (k) are formed from the ADM bits and then 

X 

they are sampled at the PCM rate, f^. We observe that 

x (Rk) = x (t = kT N ) = x ( t = RkT s ) (3.1-7) 

since 

T n = l/f N = RT S . (3.1-8) 

To obtain £ v (k) from e„(k),'we must realize the inverse 

A A 

of a hard limiter. But, there is no physically realizable 
one-to-one inverse of a hard limiter. The information lost 
going from £ (k) to e (k) cannot be. recovered. However, 
the basic idea of improving the ADM estimate is still a 
valid concept. This is exactly the problem that we are 
faced with, that is, how to improve- x(k) before we decrease 
the "information" rate from f g to f N by sampling at the Nyquist 
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rate. 

The PCM values obtained in this way are in a linear 
PCM format. However, most existing PCM systems use a com- 
panded code. To achieve compatibility, we can use a simple 
ROM as a digital code converter since there is a one-to-one 
mapping between linear and companded PCM. 

3.2 ADM Decoder Technique 

The ADM to PCM converters that will be discussed are 
applicable to any ADM that can be described with Eqs . 

(2.1-1) through (2.1-4). However, when simulating and ob- 
taining performance curves , we must use a particular ADM 
mode. Since we are confining our applications to speech 
signals, all references to the ADM step size will apply to 
the Song audio mode algorithm given in Eq. (2.1-6). 

The simplest and most obvious method of converting an 
ADM encoded signal to a PCM encoded signal is to decode 
{e x (k)} by generating and accumulating the step sizes, 

S v (k), to form the ADM estimate ,' x (k) . By the very nature 
of the DM digital feedback circuit, x(k) is a parallel digi- 
tal word. Since the DM operates at a rate much higher than 
the Nyquist rate, the estimate must be resampled, via a bank 
of AND gates , at the Nyquist rate , to yield PCM words , 
x (Rk) . This device, called the ADM estimate converter, is 
shown in Fig. 3.1-1. In this converter, we have set £^(Rk) 

= 0 in Eq. (3.1-6) and, therefore, we have not improved 
x (Rk) at all. 
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/ / Tyixri Stic ally, we can argue that this technique will 
/nc\/produce a high quality PCM- signal regardless of the num- _ 
/her of bits used in the accumulator to form x(k). This is 


due to the high probability of. choosing a "poor" value of 
x(k), i-.e. , a sample yielding a large error between it .and 
the true value, x(k). A "poor" ADM estimate is often pro- 
duced when the. step size has grown too large causing the 
estimate 'to overshoot the input signal. If the input con- 
tinues to increase, the estimate must reverse direction for 
one ADM period, due to the overshoot, before it again con- 
tinues to increase. The one period, where the estimate has 
reversed direction, generally yields an extremely "poor" 
value of x (k) . 

Consequently, although we can obtain a high quality 
representation of the original . signal by analog low pass 
filtering the entire ADM estimate, the same is not true if 
we filter samples of the estimate taken at the Nyquist rate. 
When x (k) is passed through a LPF, the "poor" estimate 
values, occurring for only T s seconds, are easily averaged 
out because the LPF cutoff frequency is much less than f s . 
However, since the PCM samples occur at the Nyquist rate, a 
"poor" value will give rise to a considerable error, even 
after final low pass filtering. This has been verified 
through computer simulation and will be presented later. 

The analog LPF is used to return to the analog domain, where 
performance is evaluated and for no other purpose. 

The conclusion of this heuristic argument can be further 
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strengthened with a frequency domain analysis of the ADM es- 
timate converter . The ADM encoding process , even when oper - 

I 

£ 

ating on an initially bandlimited signal, always generates 
out-of-band frequency components in the estimate. If we 
let M(f) represent the spectrum of x(k) , then M(f) will not 
be bandlimited to f . In this converter, the basic opera- 
tion that must be performed to achieve a PCM format is samp- 
ling at the Nyquist rate, f N . -The sampling operation causes 
a shifting of M(f) along the frequency axis. The .spectrum 
of x(k) sampled at the Nyquist rate is given as, 

co 

M (f ) ’ = M (f ) + Z [M (f + if„) + M(f - if )] , (3.2-3) 

N i_l w 

where the above additions- are performed vectorially since 
M(f) is a complex quantity.- The result of sampling a non- 
bandlimited signal is, of course, aliasing. It is precisely 
this fact that causes distortion in the resultant PCM sig- 
nal and, therefore, a low quality representation of' the 
original signal which, as we shall see later, manifests it- 
self as a low SNR on our performance curves.. 

To eliminate the "poor" values of x(k) and still main- 
tain a completely discrete system, we can insert a digital 
LPF after the DM estimate, just before the gating device 
operating at the Nyquist rate. This digital filter may be 
viewed as a device which filters in the frequency domain, 
produces a statistical estimate or performs a digital inter- 
polation. In all cases, it will decrease the out-of-band 
noise and make all -the estimate values accurate before we - 
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resample-. This concept will be further pursued in the next 
section. 

3.3 Non-rRecursive Digital LPF Technique 

The objective .of the ADM to PCM converter is to elimi- 

A , , 

nate the "poor" values of x(k) before resampling. Since 
these "poor" values are surrounded by many "good" values of 
x(k) , some averaging or filtering of x(k) before Nyquist 
sampling should improve the PCM signal. The method pre- 
sented to achieve this objective is .an extension of the con- 
cept originally proposed by D. Goodman [19] to perform ana- 
log to PCM conversion using a DM as an intermediate step. 

We now apply, this technique to a general class of ADMs 
rather than to merely a linear DM which was .done in this 
reference. Goodman used a minimum mean-square error cri- 
terion to determine the -coefficients in the non-recursive 
digital filter. To complete the design, it was necessary 
to assume input signal statistics. In our system, we em- 
ploy a method to determine the filter coefficients which is 
completely independent of input signal statistics. Our de- 
sign is therefore robust. 

To improve the PCM converted signal over that obtained 
from the system shown in Fig. 3.1-1, we insert a low pass 
filter after the accumulator to eliminate the spurious fre- 
quency components of the signal estimate. The ADM to PCM 
converter now has the 'step size, S x (k), acting as the input 
of two cascaded, linear filters. The latter of these linear 



filters is sampled at the Nyquist rate to produce improved 
PCM samples, x(Kk). The block diagram of this system is 
given in Fig. 3.3-1. The accumulator is represented as an 
ideal integrator, whose impulse response is 

a(t) =1, t >_ 0 , (3.3-1) 

= 0, t < 0 , . 

and the EPF is designated by its impulse response, h(t). 

Since both a(t) and h(t) represent linear systems, 
they can be combined into one linear filter, via convolu- 
tion, i.e. , 

t 

g(t) = a(t)±h(t) = /' a(t - X)h(X)dX , (3.3-2) 

— CO 

where the upper limit is due to the causality of the accumu- 
lator, that is, a (t - X) = 0 for X > t. For the limits of 
integration in Eq. (3.2-2), a(t - X) =1, and therefore 

t 

g (t) = / h(X)dX , (3.3-3) 

— CO 

which is merely the unit step response of the LPF . The im- 
proved ADM- estimate, x(k) , can be formulated from the fol- 
lowing discrete convolution, 

<x> 

x (k) = 2 S x (k - j)g(j) , (3.3-4) 

j=-°° 

where 

g ( j ) = g(j T s ) 

T = the ADM sampling period, 
s 


and 




Fig. 3.3-1. Improved ADM Estimate Converter 
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Since g(t) represents the unit step response of a LPF, 


we know that 


lim g(j) = 1 , (3.3-5a) 

j-KO 


and there exists a value of j for which g(j) is arbitrarily 
close to 1. If we designate this value of j as Q, then we 
have 

g { j) 1, for j >_ Q . (3.3-5b) 

The improved ADM estimate can therefore be approximated very 
closely by ' 

Q-l 

x (k) = 2 S (k - j)g(j) + 2 S „(k - j) . (3.3-6) 

• it ■ /n “ » 

- 1=-“ d=Q 

If we change the index in the second sum, letting i = k - j , 
then 

co k-Q 

.2 S fk - j) = 2 S„(i) = x(k - Q) . (3.3-7) 

• it * ^ 

3=Q 1=“” 

Specifying the LPF as being causal’ so that h(t) = 0 for 
t < 0 and, consequently, g(t) = 0 for t <0, the final dis- 
crete form of x(k) is given as 

Q-l 

x(k) = E g(j)S (k - j ) + x(k - Q) . (3.3-8) 

j=0 x 

, > 

From Eq. (3.3-8), we -observe that the original ADM es- 
timate, x(k - Q) , is modified by the addition of a weighted 
•sum of past step sizes. The PCM samples now take the exact 
form suggested by Eq. (3.1-6) ,' except for a time delay in 
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tiie ADM estimate.. This entire system is depicted in Fig. 
3.3-2,- where we show an ADM to PCM converter with a non- 
recursive digital filter. The advantages of this configura- 
tion are that the filter is absolutely stable, the coeffi- 
cients of the filter can deviate from the exact value without 
drastically affecting the filter frequency characteristics, 
and, as pointed out in a somewhat similar practical realiza- 
tion- of this concept [20], the hardware capacity needed for 
filtering S (k) is much less than that needed if we opera- 
ted on the estimate, x(k), with a non-recursive filter. 

In the realization of the ADM to PCM converter using a 
non-recursive filter, there are several practical consider- 
ations that should be pointed out. Since the filter coeffi- 
cients do not require extreme precision/ we may be able to 
realize the products g(j)S x (k - j) by employing hard -wired 
scalers as discussed in Sec. 2.2. Thus, we eliminate the 
need for digital multipliers and reduce the hardware com- 
plexity of the system. 

The hardware structure for this converter can be com- 
pletely modified by recursively realizing the product 
g(j)S x (k - j) from the ADM bit stream. Let us define this 

term as 

v. (k) = g(j)S (k - j) . (3.3-9) 

3 -*• 

Using the Song audio mode algorithm for the step size, Eq. 

(2.1-6), the product becomes 



s 

s x (k) 
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Vj (k) - g(j) ls x (k - j - 1) le x (k - j - 1) 

■+ g(j)-Se x (k - j - 2) . 1 


(3.3-10) 


If we employ the step size relationship given in Eq. 
(2.4-4), we obtain 


v. (k) .= g(j)S x (k - j - 1) e x (k - j - l)e x (k j 2) 

+ g ( j ) Se (k - j - 2). (3.3-11) 

Expressed recursively, the product now becomes 

v • (k) = v • (k - l)e (k - j - l)e x (k - j - 2) 

3 J x . 

+ g(j)Se x (k - j - 2). (3.3-12) 

The block diagram realization of Vj (k) is shown in Fig. 
(3.3-3). 

Returning to Eq. (3.3-8)., the improved estimate can be 
formulated as 

Q-l A 

x (k) = E v . (k) + x(k - Q) . (3.3-13) 

j=0 3 

The block diagram corresponding to this equation for the ADM 
to PCM converter with non-recursive filter is given in Fig. 
(3.3-4). Although there is no saving in hardware with this 
modified realization, the accuracy of the product is im- 
proved. This can be seen from Fig. 3.3-3. Even though we 
still must scale by g(j), here we are scaling one minimum 
step size rather than S x (k - j). Even if the numerical scale 
factor is a gross approximation to the true value, the most 









I- — Q Delays — — H 



Fig. 3.3-4. Modified Realization of ADM to PCM Converter with Non-Recursive Filter 
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error, that could arise is one minimum step size. 


3.3.1 Realizing an Ideal Digital LPF- 

Now that we have derived a digital structure for ADM 
to PCM conversion, the only design that remains is the 
choice of the filter coefficients, g(j). Since the objec- 
tive of the filter is to eliminate the spurious out-of-band 
frequency components, we wish to obtain the best out-of-band 
noise rejection with the least in-band signal, distortion. 

In an attempt to achieve this , we employ a time' domain de- 
sign technique utilizing the unit step response of an ideal 
low pass filter (ILPF) , i.e., 

g(t).= 0.5 + (l/ir)Si(2irf c t - K Q ) (3.3-14) 

where 

Si (a) = / sin x dx , (3.3-15) 

0 x 

f = f = f w /2 = the cutoff frequency 

of the ILPF , 


and 




2TT-f T , 
c d 


(3.3-16) 


= the constant time delay of the ILPF. 

\ 

In Fig. 3.3-5, we plot g(t) as a function of time normalized 
by l/2irf c when K Q — 0 . 

Although an ILPF is non-causal and, therefore, not 
physically realizable, this does not hinder our design of 
the digital filter. When a non-recursive digital filter is 
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constructed, we can choose any coefficients desired to simu- 
late a given characteristic. In our design, we are not con- 
cerned with the time delay, T^, nor are we concerned with 
the anticipatory response of this’ analog ILPF. We only 
focus on the Q values of g(t) found between the asymptotic 
limits of 0 and 1 that'g(t) approaches as t gcies to minus 
and plus infinity. These Q values of g(t) complete the de- 
sign. 

Since we are not concerned with the ILPF time delay, 

we shall set K such that the values of the filter coeffi- 
o 

cients are symmetrically distributed about 0.5,. To deter- 
mine the value of Q, we must specify the desired filter rise 

• time, T r , or the region. <j> r , shown in Fig. 3.3-5’, outside of 

which we assume that g (- j ) takes on only values arbitrarily- 
close to' 0 or 1. If we set a value of <f> r , then we can 
calculate 

T r = 0 r /2irf c ’. (3.3-17) 

We observe that Q values of g(j). imply Q - 1 intervals of T s 
seconds in T r . Therefore, 

T = (Q - 1) T (3.3-18) 

1 b 

or 

q = 4) r R/7T + 1 (3.3-19) 

which is found by setting R = f s /f N - Because Q must be an 
integer, we shall specify it as 
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Q = T<J) r RA1 + 1 (3.3-20) 

where 

f,a1 = the greatest integer £ a . 

Now we can determine the 'filter coefficients by evalu- 
ating g(t) , at t = jT , symmetrically about 0.5. The coef- 

S 

ficients are given as 

_ g ( j ) = 0.5 + ( 1 / tt ) S i (it ( j - R q )/R) (3.3-21) 

-where 

j = 0.,-l, , Q - 1 , 

and 

- R q = 0.5r<f> r R/iTl . (3.3-22) 

Implicit in this evaluation of coefficients is that g(,j.) is 
set to zero to the left of cj> r and set to one to its right. 

It is seen from Table 3.3-1 that the coefficients obtained 
from this technique, via Eq. (3.3-14) , are within 1% of the 
values obtained by Goodman [21] for the example documented 
in this reference. We stress that these coefficients are 
independent of the input signal statistics. 

3.3.2 Characteristics of the Ideal Digital LPF 

The algorithm for the improved ADM estimate, i.e., Eq. 

• (3.3-8), does not show the effect of the non-recursive fil- . 
ter on the original estimate, &(k). However, with some 
algebraic manipulations, we can transform the ADM to PCM 
converter shown in Fig. 3.3-2 into the cascade arrangement 
depicted in Fig. 3.3-6. Repeating Eq. (3.3-8), 



j 

g(j) OBTAINED BY 
ILPF TECHNIQUE 

g ( j ) OBTAINED BY MINIMUM 
MEAN-SQUARE ERROR TECHNIQUE 

■ 

0.15839 

0.15996 

2 

0.37776 

0.38571 

3 

-0.62224 

0.61437 

4 

0.84161, 

0.84013 

5 

1.00000 

1.00009 


TABLE 3.1-1.’ Coefficients for the Non-Recursive 
Digital LPF 



















94 


x(k) = x (k - Q) + 2 g (i) S (k - i) , (3.3-8) 

i— 0 X 

and observing that Eq,. (2.1-4) can be rewritten as 


S x (k) = x(k) - x (k - 1) , 

we now see that 


(2.1-4) 


Q-l 

x(k) = x (k - Q) + 2 g (i) 

i=0 


(3.3-23) 

• Cx (k - 1) - x (k - i - 1) ] . 

Taking the Z-transform of Eq. (3,3-23), assuming zero ini- 
tial conditions, we obtain the form of the cascade filter. 


-o -1 Q_1 

H (z) = X(z)/X(z) = z Q + (1 - z x ) 2 g(i)z 

i=0 


where 


and 


X(z) = the Z-transform of x(k) 
X(z). = the Z-transform of x(k) . 


(3.3-24) 


By taking advantage of the symmetry of the g(i) coef- 
ficients about 0.5 and letting 

z = exp(ja)T ) , (3.3-25) 

we can determine the frequency char aoteri sties of the cascade 
filter. The following transfer function was derived from 
the filter structure used in simulation where Q was an even 
integer and g(0) = 0, 
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H CD (f) = exp (- j (Q + l)Trf/2Rf c ) (-{cos (ir (Q - l)f/2Rf c ) 

Q/2-1 

+ 4sin (7rf/2Rf ) [ S g' CQ/2' - i) sin (iirf/Rf ) 0 } 

C i=l c . • 

(3.3-26) 

+ j{-sin(Tr(Q - l)f/2Rf_) +■ 2sin(irf/2Rf ) ' 

Q/2-1 

• [0.5 + £ cos (iirf/Rf ) ] }) , ' 

where ‘ 

g' (i) = 0.5 - g(i) . (3.3-27) 

A derivation of H^ D (f) is given in App. 3. 

Since our simulation uses an input tone of • frequency f Q 
and a cutoff frequency of 4f to determine SNR for the audio 
mode ADM, we .'shall plot H CD (f ) on a frequency' scale normal- 
ized to f Q . Figure 3.3-7 displays the amplitude and phase 
characteristics for the case where R = 8 and Q = 10, repre- 
senting 9 values of g(t), between g(l) = 0.064 and g(9) = 

0.9 36, symmetric about g(5) = 0.5. In this example, 4> r only 
extends from Q 0 to Q 1 (see Fig. 3.3-5) since larger values 
of <j> r , and consequently more g(i) coefficients, afford negli 
gible SNR improvement. 

In Fig. 3.3-8, we plot the amplitude characteristics of 
H CD (f) for the other two cases considered in our simula- 
tions, i.e., R = 6, Q = 8' and R = 4, Q = 6. In both cases, 
g(0) =0 and the g(i)s fall between. Q o and Q l on Fig. 3.3-5. 
Note the similarity with the amplitude characteristics when 
R = 8 and Q = 10. The phase characteristics for these last 






1 6 8 10 
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(b) R=4, Q-6 


Fig.3.3-8. Amplitude Characteristics of Converter 
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where (a)R=6,Q=8 ,(b)R=4,Q=6 
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two cases are similar to the plot shown in Fig. 3.3-7. The 
phase is extremely linear with the slope changing from -28f Q 
degrees/second when R = 8, Q = 10 to -30f o degrees/second 
and -34f Q degrees/second when R = 6:, Q = 8 and R = 4, Q = 6, 
respectively. 

From the frequency characteristics of the converter 
filter, we see a disadvantage to the ADM to PCM converter 
described above. There is a definite shaping of the in-band 
spectrum due to the attenuation below f c . This will cause 
distortion of the signal. In determining the performance 
curves , this attenuation was corrected for so as not to 
yield misleading results. If this was not done, the SNR of 
•the converter with non-recursive filter would sometimes be 
greater than the SNR of the optimum converter {described in 
a later section) , which employs analog demodulation. After 
the performance curves are presented, we shall discuss reme- 
dies for, and alternatives to, the in-band spectrum shaping. 

Equally important as realizing that spectral shaping 
does occur is the explanation of why it exists at all in 
this system. Our initial design employs the unit step re- 
sponse of an ideal LPF simply because it has the most desir- 
able frequency characteristics. However, the brick wall 
frequency characteristics only hold if we realize the analog 
ILPF. The ADM to PCM converter utilizes a digital LPF which 
uses a finite number of discrete points on the unit step re- 
sponse. h cd ^ not approach a brick wall characteris- 

tic if we use more points on the tails 'of the g(t) curve. 
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This can be accomplished, by choosing the points closer toge- 
ther. However, to. maintain the same cutoff frequency, we 
would have to increase the ADM bit rate. But, in ADM to PCM 
conversion 'Of this type, we are constrained to a previously 
set ADM rate. Thus, we are not at liberty to use this tech- 
nique to eliminate spectral shaping. 

3.3.3 Converter Simulation and Sinusoidal Response 

Using our PDP 8/L computer with 8K memory we simulated 
the Song audio mode ADM to encode test signals. Then we 
simulated the ADM to PCM converter with non-recursive filter 
exactly as depicted in Fig. 3.3-2. The original system used 
R as 8, Q = 10 and thus had 9 filter coefficients. These 
coefficients were approximated by the nearest integral mul- 
tiple of 1/16 to simulate a hard-wired scaler. The initial 
test employed a sinusoidal signal encoded by the ADM operat- 
ing at a rate which was an integral multiple of the input 
sinusoid frequency. The ADM bit stream, {e x (k)}, was then 
used as the input to the converter. 

Whenever the ADM bit rate is an integral multiple of 
the input sinusoid frequency, we know that the estimate, 
x(k) , will assume a periodic sinusoidal steady state pat- 
tern. Since the improved estimate, x(k), and the resulting 
PCM samples are derived from x(k) by linear filtering opera- 
tions, these signals also take on a periodic pattern. The 
periodicity of x(k) and x{k) was verified by the system 
simulation. 
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To show the qualitative improvement of the ADM estimate 
afforded by the non- recursive digital filter, we have dis- 
played, in Fig. 3.3-9, the improved ADM estimate, x(k). We 
have also plotted the delayed analog input and the original 
ADM estimate, x(k). These curves represent a converter where 

i 

R = 8 and Q = 10 , .exactly as described in Sec. 3.3.2. This 
emphatically shows the "poor" PCM samples that can be ob- 
tained from x(k) and the consistently good quality of virtu- 
ally all the samples of. x(k). 

3.3.4 Evaluation of Performance 

The families of performance curves are obtained with 
the same approach as discussed in Sec. '2.8. With a single 
tone input, we obtain a periodic pattern for x(k), x(k) and 
the resulting PCM samples. Thus, all of these waveforms can 
be expressed as a Fourier series . The frequency components 
of these series can be calculated and used to determine out- 
put SNR. Let the frequency of the sinusoid be f Q . We have 
shown in Ch. 2, adhering to the assumptions made there, that 
the ADM estimate, and any signal derived from it, can be ex- 
pressed in the form 

CO 

x(t) = C Q + E C n cos (2rnf 0 t + <f> n ) , (3.3-28) 

n=l 

where C Q , C n and tf> n are defined as- the standard Fourier am- 
plitude and phase coefficients, i.e., Eqs . (2.8-3b) through 
(2 . 8-3f ) .' We have shown, in Sec. 2.8, that the calculation 
of these coefficients is -readily adaptable to computer 
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simulation. 

In determining the frequency spectrum .of the PCM signal, 
we utilize the Fourier series technique in two different 
ways, depending* on the conversion system under analysis. 

The' time domain approach simulates the entire converter and 
determines- the ‘Fourier components, C , from the periodic 
pattern of the PCM samples. The time and frequency domain 
approach computes the amplitude . and phase components of the 
ADM estimate (C n and (j> ) and then simulates digital low pass 
filtering, resampling and holding with the appropriate 
transfer functions in the frequency domain. Digital low 
pass filtering uses H CD (f) from Eq. (3.3-26); resampling em- 
ploys the frequency shifting given in Eq. (3.2-3); and the 
holding circuit, for the Nyquist period, is described by [22] 

G ( f) „ sin(irf/f N ) . . (3.3-29) 

The former of these two techniques cannot be used if we 
wish to correct for the spectral shaping caused by'H CD (f). 
Consequently, we must employ the latter method. Applying 
this approach to the cascade arrangement of the ADM to PCM 
converter with the non-recursive filter (Fig. 3.3-6), the 
held PCM spectrum is given as - 

oo 

- G H (f> Z JtCf + if N > H CD (f + iff,) ' I 3 - 3 ' 30 * 

where 

X(f) = the frequency spectrum of the ADM estimate 
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and H£ D (f) represents the cascade digital LPF' after spectral 
shaping -has been eliminated. The correction is accomplished 
during simulation by setting the amplitude of H£ D (f) to be 1 
at f = f Q , 2f Q and 3f Q , and by specifying it as 0.707 at 
f = f c = 4f . The phase of H CD (f) was left unchanged. If 
this correction was not made,' H CD (f) would attenuate the 
•second through fourth harmonics. We would then have less 
harmonic noise and, therefore, a higher SNR. All operations 
in Eq. (3.3-30) are performed on complex quantities. Thus, 
the multiplications and additions are actually vector 
products and vector sums . 

Since we are concerned with an. audio mode ADM, we again 
choose an output LPF, to return to the analog domain, which 
is applicable to voice signals, i.e., a fourth-order Butter- 
worth LPF whose frequency characteristics are given in Eq. 
(2.8-7). Exactly as in Sec. 2.. 8.2, we choose the LPF cutoff 
frequency, f c , to be 4f Q where f Q is our input tone. The. . 
LPF attenuation factor, a n , is the same as Eq.- (2.8-9) and 
the output signal -to-noise ratio, SNR Q , is given by Eq. 
(2.8-12), where C n now represent the strength of the Fourier 
components of the output PCM signal obtained from Eq. 
(3.3-30). 

To avoid several infinite sums and products in the 
actual calculation of the held PCM 'spectrum, Nj^jj(f) , we 
truncated the spectrum of x(k) , i.e., X(f)HQQ(f) , after the- 
ninth harmonic. The attenuation afforded by the digital LPF 
causes the frequency components of x(k) to be insignificant 



104 


from the tenth harmonic on. It was then possible to reduce 
the infinite sum in Eq. (3.3-30) to a sum from. -2 to +2. 
Because of the truncation of the spectrum of x(k), further 
sliding along the frequency axis added nothing significant 
to ^^(f), especially after the attenuating. effect of the 
holding circuit, (f ) . Finally, in determining SNR q we 

truncated the noise power after the ninth harmonic since 
( a io c io) 2 ‘ was negligible in comparison to the noise due to 
the second through ninth harmonics. As in Ch. 2, we found- 
that, for the same input signal amplitude, the periodic pat- 
tern that the ADM estimate assumes and, consequently, the 
SNR q are very, dependent upon the starting point of the input 
sinusoid. To obtain a truly representative value of SNR q , 
we averaged over 32 different starting points. All SNR 
curves are given at the end of this chapter to facilitate 
comparison between the- various conversion techniques dis- 
cussed. 


3.4- Other Digital Conversion Techniques 

In addition to the ADM estimate converter and the con- 

_T V 

verter with non-recursive filter discussed above, there are 
several other digital techniques that can be applied ■ to 
achieve ADM to PCM conversion. The most straightforward ap- 
proach is to use a cascade digital LPF before we resample. 

We could accumulate the step sizes and then LPF the estimate, 
or, low pass filter S x (k)' and then accumulate the filtered 
step sizes. Both systems are equivalent because the LPF and 
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the accumulator are linear devices and, therefore, inter- 
changeable. 

Although' L.D.J. Eggermont [23] proposed an ADM to PCM 
converter following Goodman's design technique- [24], he 
actually used a non-recursive digital filter in cascade, be- 
fore- the accumulator. He reported that "at a sampling fre- 
quency of 64K Hz the system- performed very well for speech 
encoding"- [251. However, no performance curves were given 
for his ADM to PCM converter. We have -considered using this 
same cascade technique, except with a recursive- digital LPF. 
before the accumulator. A recursive digital LPF can achieve 
a very sharp frequency .cutoff with a minimum amount, of hard- 
ware. We have designed second- through fourth-order recur- 
sive LPFs using both the impulse invariant method and the 
squared-magnitude method [26]. However, with a- recursive 
digital filter, the accuracy of jthe filter coefficients is . 
critical in maintaining stability and in obtaining the de- 
sired frequency characteristics . Since we must increase the 
hardware complexity to guarantee accurate, coefficients and 
because the converter derived in Sec. 3.3 performs so well, 
these ADM to PCM converters ,' with recursive filter, were 
never simulated. As long as the filter has a sharp fre- 
quency cutoff, this type of converter will perform well; 
but, we must deal with the coefficient problem, mentioned 
above . 

Several other authors have very recently approached the 
problem of DM to PCM conversion. T. Ohno, H. Kuwahara, 
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M. Miyata and K. Imai [27] use a linear DM to- achieve analog' 
to PCM conversion. Since they must operate the linear DM at 
a very high bit rate (8.192M Hz), -their system converts to 
PCM by using two cascaded bit reduction devices. They do 
not consider adaptive DM processors at all. On the other 
hand, J. H. Miller [28] deals with ADM to PCM conversion 
using,, only digital hardware. However, he has the added prob- 
lem that the ADM encoder which he must use is completely 
analog. Thus , he must derive the digital equivalents to all 
the analog circuits. L. B. Jackson, J. .F. Kaiser and 
H. -S. McDonald [29] also considered the use of a linear DM 
in converting from analog to PCM encoded signals . Their 
scheme employs a digital differential, technique before a 
first-order digital LPF converts to PCM format. None of 
these, however, add any additional concepts to the actual 
problem of converting from ADM encoded signals to PCM type 
signals . The -important thread that is common to all conver- 
sion techniques is the absolute need for some type of low 
pass filtering before resampling to avoid the disastrous 
aliasing effect discussed in Sec. 3.2. 

3.5 Analog Demodulation Technique 

The last ADM to PCM system that we consider decodes 
e (k) to produce the ADM estimate and then uses an analog 
LPF to demodulate x(k) before resampling at the Nyquist rate. 
This analog demodulation converter is shown in Fig. 3.5-1. 

We purposely omit the quantizer and PCM encoder after the 




Fig. 3.5-1. Analog Demodulation Converter 
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sample -and -hold (S/H) circuit because our performance evalu- 
ation is based on harmonic noise and the quantization noise 
is considered negligible. 

Although this is not a completely digital system and 
we do not want to construct this device, it is the optimum- 
converter if an ideal LPF is used to demodulate x(k) . • It 
will yield the best performance, i.e., highest SNR Q , because 
the ILPF eliminates all the out-of-band frequency components 
from the ADM estimate before PCM sampling. Thus, there is 
no aliasing to -degrade the PCM signal. Analyzing this sys- 
tem gives a good basis of comparison for the performance 
curves presented later. 

The ideal analog demodulation converter has been simu- 
lated and its performance determined by using the time and 
frequency domain approach. The ADM encoder is simulated in 
the time domain and we calculate the Fourier spectrum of 
x(k) for a single tone input using the technique described 
in Sec. 2.8. The ILPF is simulated in the frequency domain 
by eliminating all frequency components of x(k) above f c and 
letting all harmonics below f c pass unattenuated. The S/H 
circuit is simulated via the frequency shifting given in 
Eq. (3.2-3) and the holding transfer function, G H (f) f given 
by Eq . (3.3-29 ) . 

Let us define the transfer function of the ILPF to be 

G T (f) =1, - f < f , 

= 0.707, f = f c , 

- 0 , f > f c • 


(3.5-1) 
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The output of the ideal analog . demodulation converter is de- 
noted as x f (Rk) and its frequency spectrum can be expressed 
in the following manner: 

00 

X fNH (f) = G H (f) X(f + ifjjJGjff + if N ) .■ (3.5-2) 

i=s-co 

We must define G T (f ) at f because, as before, the cutoff 
frequency- is set to four times the test tone and x(k) will 
have a harmonic at f c . In calculating' SNR Q , we again use 
the fourth-order Butterworth filter, the. expression for SNR Q 
given in Eq. (2.8-12) and, -as before, truncate the noise 
power after the ninth harmonic . Similarly , SNR Q acts as a 
-random variable dependent upon the starting point of the 
input sinusoid and we average over 32 different starting 
points to obtain a mean SNR Q . 

Before we actually calculate SNR^' for the ideal analog 
demodulation converter, we can estimate that its value will 
be very close to the SNR of the ADM estimate, x(k)'. Since 
we have assumed impulse sampling at f N and negligible quan- 
tization effect, we can conclude that both x f (Rk) and x(k) 
have exactly the same in-band frequency spectrum. They both 
have out-of-band harmonics which are attenuated by the out- 
put LPFand, therefore, have a secondary effect on the SNR. 
Thus, the SNR of x(k) will be a very close approximation to 
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Comparison of Conversion Systems 
The three converters discussed at length in this chap-_ 
ter were completely simulated and tested: the ADM estimate 

converter, shown in Fig. 3.1-1, the ADM to PCM converter with 
non-re cursive filter, given in Fig. 3.3-2, and the ideal ana- 
log demodulation converter, depicted in Fig. 3.5-1. In this 
section we present the technique - used to evaluate the SNR 
for each 'system and its corresponding family of performance 
curves . These curves display the variation of SNR Q with 
relative input signal power for several ADM bit rates. Thus, 
we^ are able to present an evaluation of the- performance of 
all ADM to PCM conversion systems. 

3.6.1 SNR Evaluation 

To determine the Fourier components of the held PCM 
samples , the time domain approach was used for the ADM esti- 
mate converter. The time and frequency domain approach was 
used for the ADM to PCM converter with non-recursive filter 
and for .the ideal analog demodulation converter. In- all 
cases , we used a fourth-order Butterworth LPF before calcu- 
lating SNR q . In determining SNR Q , we truncated the noise 
power after the ninth harmonic. 

When evaluating the performance of the first converter, 
we -found that for the same input and ADM bit rate, the posi- 
tion of the gating pulse in the Nyquist interval would give 
rise to different values of SNR q . In Fig. 3.1-1, we show 
how the gating pulse, of duration T s seconds, produces x(Rk) 
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by permitting one value of x(k) through the AND gate every 
seconds. The gating time can be expressed as • 

tg. = kT N + jT s , - (3.6-1) 

where 

j ~ 0 / 1 , 2 , * * * , R — 1 . 

Initially, it seemed surprising that even though the sinu- 
soidal steady state pattern of x(k) did not change, we could 
still obtain different values of SNR Q by varying the gating 
time, i.e., j in Eq. (,3.6-1). This variation of SNR Q can 
best be explained by viewing the gating times (kT^) as fixed 
values and allowing the signal x(k) to be shifted by jT s , 
instead of shifting the gating times for a fixed x(k) . 

Now we see that we have a fixed time reference and the 
phase, or time delay, of the sinusoidal steady state pattern 
of x(k) varies with iT„. Therefore, although the shape of 
x(k) and, consequently, its amplitude spectrum remain the 
same for all values of j , the phase spectrum does not. By 
viewing the gating as resampling which causes aliasing, we 
now realize that the overlapping spectra, when added vec- 
torially, yield different results depending upon the phase 
spectrum of x(k). Therefore,- SNR 0 will be different for dif- 
ferent values of jT s . 

• For all converters , we found that SNR Q - acted as a ran- 
dom variable dependent upon the starting point of the input 
sinusoid. For the first converter, both the gating time and 
the starting point were varied to yield 32 values of SNR Q . 
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When evaluating the last two converters' only the. starting 
point was changed 32 times because the time and frequency 
domain approach was used and it does not use a gating .cir- 
cuit. For all cases, the mean SNR Q .was calculated along 
with the standard deviation. of SNR q . 

3.6.2 Three Families of SNR Curves 

In Fig. 3.6-1 we show, for the three ADM to PCM con- 
verters, .the output signal-to-noise ratio; SNR Q , in dB ver- 
sus relative input signal power over a range of 54 dB for 
ratios of f s /f N = R = 8 , 6 and 4 . As noted in Ch . 2 , the 
input signal amplitude was varied from 5S , corresponding to 
-6 dB, to 1280S at 42 dB to generate' the curves. Of course, 
S is the minimum ADM step size found in the Song audio mode 
algorithm. For these performance curves , the test tone 
frequency was f Q ? the LPF cutoff frequency is set at f c = 
4f Q ; and the PCM rate employed is f N = 2f c = 8f Q . The plots 
shown are smooth curves drawn through windows of ±1 standard 
deviation about the mean SNR Q for various input amplitudes. 
For these curves, the standard deviation was approximately 
1-2 dB. The ADM to PCM converter with non-re cursive filter 
produces an 8-10 dB improvement over- the ADM estimate con- 
verter and, for moderately high ADM bit rates, it comes 
•within 1-2 dB of the ideal analog demodulation converter, 
which is the optimal system. 

We see from the performance curves that the ADM to PCM 
converter with non-recursive filter yields a good represen- 
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tation of the original signal in PCM format: ' By examining 

its hardware structure in Fig. 3.3-2, we observe that it is 

easily realizable with readily available digital circuits . 

In our simulation, we have used only 9, 7 and 5 filter coef-v 
ficients for R = 8, 6 and 4, respectively. It has already 
been noted that more coefficients resulted in negligible 
increase in SNR Q . The other advantage of this structure is 
that the -accuracy of the filter coefficients is not extremely 
critical. The coefficients used in the simulations were ap- 
proximated by the nearest integral multiple of 1/16 . This 
represents, at most, an additional 4 bits needed in the in- 
ternal arithmetic. For this case, we suffered about 0.1 dB 
decrease in SNR Q . 

Let us return to the problem of- spectral, shaping caused 
by the frequency characteristics of the converter filter. 

It has already been noted that we are not at liberty to rec- 
tify this by choosing -more filter coefficients closer toge- 
ther on the g (t) curve. The spectral shaping can, however, 
be remedied by using an output digital filter that has in- 
band characteristics which are the inverse of H^p(f) . 
Alternatively, it could be corrected by using a better method 
of choosing the filter coefficients, such as starting with 
the .frequency domain filter characteristics and then calcu- 
lating the time domain coefficients. 

A final idea would be to redesign the system, similar 
to Fig. 3.3-6, and construct a purely cascaded digital fil- 
ter. However, by using the rather gross time domain design 



method presented in Sec. 3.3, we have come to' within 1-2 dB’- 
of the optimum converter performance. Thus,- one can ques- 
tion the need to resort to very sophisticated filter design 
techniques. We have, in any event,, shown conclusively that 
we need some sort of LPP before PCM sampling and why we can- 
not do without it. Thus, regardless of the structure and 
how it is designed and implemented, . an ADM to PCM converter 
must employ a LPF before resampling if we are to achieve 
acceptable, performance. 
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CHAPTER 4 

CONVERSION FROM PCM ENCODED SIGNALS 
TO ADM ENCODED SIGNALS 

In this, chapter, we consider the dual of -the problem 
addressed in Ch. 3, that is , ' conversion from PCM to ADM for- 
mat. We can describe a PCM to ADM converter as a device 
which, operates on values of the information source, occur- 
ring at the Nyguist (or PCM) rate, and produces an ADM bit 
stream. Since there- is a unique mapping between the ADM 
bit stream and the. ADM estimate (when the ADM initial con- 
ditions are specified) , and since the ADM operates at a rate 
several times TTxgher than the Nyquis.t' rate , we are convert- - 
ing from a low "information" rate (the PCM samples) to a 
high "information" rate (the ADM estimates) . 

Several techniques are developed to perform this type 
of conversion". One uses the probabalistic statistics of the 
information source. Another employs the spectral parameters 
of the input signal. Still another is completely non-para- 
metric. All techniques deal with the lack of information 
about the signal excursion between PCM samples. The resolu- 
tion of this problem dictates the structure of each PCM to 
ADM converter. 

All the PCM. to ADM converters that we design are restric- 
ted to circuits that are physically realizable, with standard 
digital hardware and which entail a minimum amount of hard- 
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ware complexity. The sole constraint applied to all conver- 
sion systems is that the ADM bit rate is an integral multi- 
ple of the Nyquist rate. The PCM to ADM converters pre- 
sented in this chapter wil either be statistically analyzed 
or simulated on a digital computer or both. In all cases, 
we shall generate SNR curves so that the performance of the 
converters can be objectively evaluated. 

4.1 DM Signal Estimate Tree - 

' To illustrate the conceptual difficulties associated 
with PCM to ADM conversion, we introduce a "DM signal esti- 
mate tree" and construct part of this tree for a particular 
variable step size DM. A "DM signal estimate tree" is a 
graph' of all" possible ^path's'“idfat” €H’e'j = DM^e , s'tima.te , x(k), may 
follow starting with a set of initial conditions. The paths 
are generated from all possible binary sequences of the DM 
bits, e v (k). Every variable step size DM will give rise to 
its own particular "estimate tree" but each tree exhibits 
the same problems for PCM to ADM conversion. Thus, the con- 
ceptual difficulties are universal to all DMs . 

4.1.1 Paths through the Signal - Estimate Tree 

Since we are primarily concerned with speech signals, 
without loss of generality, we shall invoke the Song audio 
mode algorithm whenever we refer- to an- ADM. In Fig. 4.1-1, 
we show part- of a 'DM estimate tree" for this particular step 
size algorithm, i.e., Eq. (2.1-6), on which we have super- 
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imposed two PCM samples, at points A and B. Now we observe 

n 

where the difficulty lies in converting, from PCM to ADM ‘for- 
mat. In going from the starting point to points on .the "DM 
estimate tree" which are adjacent to. point B, that is, points 
B 2 and B 2 , we can traverse any of four possible paths: r x , 

r 2 ,- r 3 or r 4 . Which path to choose is the problem in PCM to 

v 

ADM conversion. We shall. -term this the "multipath” problem. 


4 . 1.. 2 Path, Endpoints 

The complexity of the "multipath" problem can be some- . 
what reduced by coping with another conceptual difficulty , 
the "endpoint" problem. Because the "DM estimate tree" di- 
verges so rapidly for a variable step size algorithm, the 
PCM samples may not always lie” on a bran'ch in the tree. 
Although a PCM sample, like point B, in Fig. 4.1-1, can take 
on any one of the integral values of S, the estimate, at 
that time, is restricted to endpoints of the ADM paths orig- 
inating from the starting point. By first choosing endpoints 
for the PCM samples, we automatically eliminate some pos- 
sible paths through the "DM estimate tree" and , thereby , re- 
duce the complexity of the "multipath" problem and the re- 
sulting PCM to ADM conversion. 


4.2 Statistical PCM-ADM Converter 

There are several approaches to the PCM to ADM conver- 
sion problem, but they all require the addition or derivation 
of more information about the signal source or about the 
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excursion of the actual signal. For the techniques con- 
sidered later, we shall estimate the signal excursion at 
discrete points between PCM samples and essentially fit 
these values to a path through the ADM signal estimate tree. 
For the statistical PCM to ADM conversion technique-, we mus.t 
introduce a set of probabalistic statistics for the input 
signal. . .. 

Let us assume that we have a stationary information 
source, x(t), which is bandlimited to f m , and that the ADM 
bit rate, f g , is an integral multiple of the PCM rate, f^; 
that is. 
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We can assume that the conversion is a continuing pro- 
cess and we are choosing a path between each adjacent pair 
of PCM samples. Thus, the initial conditions for each tree 
are known from the previous path chosen. The estimate path 
is mapped into one of the 2 R possible R-bit sequences repre- 
senting e x (k) in each Nyquist interval. When evaluating, the 
"estimate tree" in each PCM period, we need not consider all 
2 r sequences in our .quest for the most 'likely path. As seen 
in Fig. 4.1-1, we can limit ourselves to those paths actu- 
ally going between possible endpoints.. 

The method that we shall describe for determining the 
most likely path is extremely general and can be applied to 
virtually any ADM system. This technique is based bn the 
most elementary principle of DM operation. If the signal 
value is greater than the estimate, i.e., x(k) > x(k) , then 
the estimate must increase and e x (k) = +1. Likewise, if the 
signal value is less than the estimate, i.e., x(k) < x(k) , 
then the estimate must decrease and e x (k) = -1. Using this 
principle, along with the joint statistics of x, we can cal- 
culate the probability of each possible path. The obvious 
criterion to use is : the most likely path has the highest 

probability. That path is chosen and mapped into its ADM 
bit sequence. By using the given PCM values at the end- 
points, we can eliminate some of the possible paths at the 
f 

outset and thus reduce the necessary computation. 
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4.2.1 Choosing Tree Path Endpoints 

For each Nyquist interval, we have a starting point de- 
fined .as the' end of the estimate path traversing the previ- 
ous interval.. Emanating' from- the starting point will be 
several possible ' estimate paths which terminate at or are 
adjacent to the next PCM sample. If no path goes through 
the next PCM sample, then we have 'two possible endpoints, - 
as shown. on the tree' in. Fig. 4.1-1. Since we wish to use 
the PCM samples as advantageously as possible, point B shall 
be used to determine the path endpoint. . . 

The criterion that we shall employ to choose the .end- 


point is 

extremely simple: 

select the point. that will yield 

the least error 

between it . 

and the PCM sample. Let 

us de- 

fine the 

error 

for points B 

and B 2 , respectively. 

to be 

■ 


£ B i 

1 Bj - B | 

(4.2-5) 

and 



- 

■ 



e B 2 = 

|B 2 - B | 

(4.2-6) 

We apply 

the following rule 

to choose the endpoint: 



if 

£ B 1 < £ b 2 ' 

choose Bj , 



if 

£ b 2 < £ b 1 ' 

choose B 2 , 

(4.2-7) 


if 

£ b i = £ b 2 7 

choose B 1 and B 2 . 



This is equivalent to choos-ing the endpoint closest' to the 
PCM sample. By choosing either B x or B 2 , we automatically 
eliminate all paths going to B 2 pr B ]( 
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4.2.2 Choosing the Most Likely Path 

To best explain the technique . for determining the most 
likely path, we apply this procedure to the example given in 
Fig. 4.1-1. ’ By using the initial conditions of the "esti- 
mate tree" and the PCM sample at the beginning of the path, 
we determine the first e (k) and try to eliminate some pos- 
sible paths. From Fig. 4.1-1, we see that e B = , so we 

choose both endpoint, Bj or B 2 , and must consider paths r t , 

r 2 , r 3 and r 4 . Observe that the PCM sample A = x(l) > x(l) 

/ 

so that e x (l) = +1 and path r 4 is eliminated. Now we must 
only calculate the probability of paths r , r 2 'and r 3 . 

The probability density function used to determine the 
most likely path also takes advantage of the specified PCM 
value at the beginning of the path. . This conditional prob- 
ability density function is expressed as 

Px = ■A) “ Pjj- (A , CX2 » ® 3 / ® 4 ) /Pjj ^ r ( 4.2 8) 

where the marginal density function is given as 

CO 

Px (<*!> = ///p x (a x ,a 2 ,g 3 ,a 4 )d a 2 da 3 da 4 .. (4.2-9) 

1 »— CO 

Now we can calculate the probability of path r 1 , r 2 and r g . 
Let us call these path probabilities P r ^, and P.^, re “ 

spectively . By tracing each path through the tree, with the 
aid of the step size algorithm for the Song audio mode ADM, 
we find that the probability of path r i can be expressed as 
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P_ “ P (x (2) >S , x (3) >3S, x (4) <6S) 

(4.2-10) 

CO CO 6S 

= / / / P x | x (a 2 ,a 3 ,a 4 |a 1 =A)da 2 da 3 da lt . 

S 3S -« i 

Similarly, the probability of path r 2 is seen to be 
P r = P(x(2)>S, x (3) <3S , x (4) >2S) 

(4.2-11) 

oo 3 S 00 

= / / / Pxlx (a 2 /a 3 ,a 4 |a 1 =A)da 2 da 3 da 4 . 

S -» 2S 1 


Finally, we formulate the probability of path r 3 as 
P r - P (x (2) <S , x (3) >S , x (4) >0) 

3 

(4.2-12) 

S OO CO . 

= / / /p„i„ (®2 ' a 3 ,a 4 |a 1 =A)da“ 2 da 3 da 4 .. 

-co s 0 — 1 i 

Now we apply the criterion that the most likely path 
has the highest path probability and state the path decision 
rule thusly: 


if P r 

> 

p r 

and 

P r ' 

choose 

r i ' 

1 


2 


3 



if P r 

> 

P r 

and 

P , 

r* 

choose 

r 2 ' 

2 


1 


3 



if P r 

> 

P r 

and 

P r ' 

choose 

r 3 * 


3 1 2 


The chosen path is mapped into its e x (k) sequence and one 
cycle of the PCM to ADM conversion is completed. The- pro- 
cess is subsequently repeated with the introduction of each 
new PCM sample. 
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This concept can be expanded to more than one Nyquist 
period/ making the possible paths through the tree longer 
and taking advantage of the interdependence between the 
paths and several PCM samples. Alternately, we can modify 
the original procedure by not choosing an endpoint by apply- 
ing Eq. (4.2-7). Instead, we might weight the path proba- 
bilities with a monotonically decreasing function of the 
endpoint error, e, such as 1/e. Our most likely path deci- 
sion will then be based on the largest weighted path proba- 
bility. 

There are, of course, many other variations on this 
theme. However, we stop here without an evaluation of the 
converter performance because we are searching for a robust 
system, not dependent on the probability statistics of the 
speaker. Using this system would require a "learning" 
period, during which time the machine determines the proba- 
bility statistics of the speaker. This would have to be 
done for each speaker I Under these circumstances, this con- 
verter becomes impractical. 

4.3 Parametric PCM-ADM Converter 

A non-statistical method of solving the "multipath" 
problem is to first employ an estimation technique that in- 
troduces information about the signal between PCM samples. 

We can use this additional information and the PCM samples 
to generate a path through the estimate tree and produce the 
ADM bit stream. The parameter of the input signal that shall 
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be used to evaluate the converter performance and estimate 
the signal between PCM samples is the power spectral density 
of x(t), G (f) . The estimation part of the converter can 
be designed' entirely independent of - the ADM employed. How- 
ever, to' generate’ the bit stream, e x (k), we must specify a 
step size algorithm for the ADM. 

4.3.1 A Simple, All-Digital Technique 

The most straightforward approach fo achieve PCM to ADM 
conversion is to use an estimation technique which yields a 
linear approximation- between PCM samples, take samples of 
this linear approximation signal at the ADM bit rate, and 
use these samples as the input to our Song audio mode ADM. 

We -then automatically generate an ADM encoded signal, e x (k), 
and, at the same. time, choose a path through the "DM signal 
estimate tree . " 

A completely digital circuit that can be easily imple- 
mented to perform this conversion is shown- in Fig. 4.3-1. 
First, we form a differential PCM (DPCM) signal, 

A(Rk) = x(Rk) - x{R(k - 1)) , (4.3-1) 

which is then digitally scaled by a factor 1/R, sampled and 
accumulated at the ADM rate, f . The output of the accumu- 

b 

lator, v(k), is an equi amplitude staircase following the 
linear piecewise waveform formed by connecting the PCM 
samples. By ADM encoding v(k), we complete the conversion. 
The scaling by 1/R can be introduced anywhere in- the conver- 



where R = f s /f N 


f N = 1 /T n = Nyquist- Rate 
D — <> t n seconds delay 

Fig. 4.3-1. A. Basic PCM to ADM Converter 
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ter and can even be entirely eliminated without affecting 
the system performance. It is merely a constant multipli- 
cative factor. We have included it in Fig. 4.3-1 merely for 
completeness so that v(k) can be accurately described. The 
sampling switch can be viewed as an AND gate being clocked 
at the ADM bit rate or, even more simply, as the accumula- 
tor clocking in the value A(Rk) R times every Nyquist period-. 

If the ADM were operated at a sufficiently high rate, 
the filtered DM estimate, denoted as w(t) , would very closely 
approximate a linear piecewise function formed by connecting 
the PCM samples with straight lines. By viewing the estima- 
tion circuit as a digital filter which transforms the PCM 
samples -into the staircase waveform, we can use the appro- 
priate inverse filter after w(t) to obtain the PCM samples 
once again. Using this approach, the SNR of the conversion 
system approaches infinity. 

This point of view is not very practical for a number 
of reasons. As mentioned 'before , the ADM bit rate is previ- 
ously set by the value of R and normally we will encounter 
moderate values of f . The transformation from the PCM 

S 

samples .to w(t) must include the ADM, which performs a non- 
linear operation. Thus, the true inverse transform is not 
readily realizable. As a more realistic approach, we shall 
use the piecewise linear waveform, w(t), without any inverse 
filtering, to obtain an upper bound on the SNR of the con-, 
version system. This will be the basis of our analysis of 
the system performance and the calculation of in-band SNR. 
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4.3.2 Optimization of Converter Performance 

The figure of merit of our converter will be the output, 
in-band signal-to-noise ratio, SNR Q . However, if we, use the 
difference between x(t) -and w'(t) as .the . source of the output 
noise, this will yield somewhat misleading results. Without 
loss of generality, we can amplify and delay w(t) to improve 
SNR Q because constant attenuation and time delay cause no 
distortion in audio signals. 

If we allow w(t) to be scaled. by a factor, K, and de- 
layed by a time, y, then the error signal that we are con- 
cerned with becomes 

d(t) = x(t) - Kw(t - y) . (4.3-2) 


We now determine the autocorrelation function of the error 
signal as • 

R d (x) = E[d (t) d (t + x)3 , (4.3-3) 

where 


E(a) = the expectation of a. 


By using the expression for d(t) given in Eq. (4.3-.2), the 

i * 

autocorrelation function of the error can be expanded to 


where 


R d (x) = R x (x) + K 2 R w (x) 

- K[E xw< T - T> + R xw (T + T)] - 


(4.3-4) 


R x (x) = the autocorrelation function of x(t), 
R w (t) = the autocorrelation function of w(t) 
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and 

R (,t) = the cross-correlation function of x(t) 
xw _ ... 

and. w (t) . 

In deriving ‘Eq. (4.3-4) , we have made - use of the fact, as 
will be shown later-, that w (t) is. a linear function of the 
PCM samples, of x(t). A consequence of this is 

E[w{t - y) x (t + t)3 = R wx (t + y) = + Y) / (4.3-5) 

or alternately, R^fct) is real and an even function of a. 

To. obtain the power spectral density of the error -sig- 
nal, we must take the Fourier transform of Eq. (4.3-4). The 
error signal power spectral density is thus seen to be 

G d (f) " G x (f) - + K 2 G„(f) - 2Kcos (2TtfY)G xw (f) , (4.3-6) 

where 

G^(f) f the Fourier' transform of R x (r) , 

G w (f) = the Fourier transform of R^t) 

and 

G_„(f)- = the Fourier transform of R ( x ) . 

' XW xw 


Due to the property of w(t) mentioned above, G xw (f) is also 
.real and an even function of f. Finally, integrating over 
the bandwidth, of x(t) , we find the in-band noise power, that 
is 


Employing Eq. 


"d 

(4.3-6) , 


f_ 

= / m G,(f)df . ; (4.3-7) 

-f m 

m 

the noise power is expressed as 
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f 

P, = P + K 2 P - 2K/ m cos (2Trfy)G (f ) df , (4.3-8) 

d x w J * - • xw 

where P x and P w are defined in a manner similar to P^ in Eq. 
(4.3-7). The signal power, P Q , is defined as the in-band 
power contained in Kw(t - y) , i.e., 

P_ = K 2 P tt . (4.3-9) 

Using Eqs . (4.3-8) and- (4.3-9), we' can formulate the 

optimized figure of merit as 

SNR opt = Q = E s /P a , (4.3-10) 

which is found to be 


Q = 


•J'i TT ^ P " ri - ' * . 



p x + K 2 P w - 2Kyt<y) 


(4.3-11) 


where 


.m 


y(y) = / cos (2irfy)G xw (f ) df 
-f 


m 


(4.3-12) 


Now we seek to maximize Q by applying 


9 2 Q(K,y) _ n 
3y3K 


(4.-3-13) 


By setting 3Q/3y equal to zero, we find. that y is a constant, 
denoted as y Q , independent of K, which satisfies the rela- 
tionship 

f m 

. / fsin(2irfy )G^(f)df = 0 . 

0 


(4.3-14) 
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The result of equating 3 Q(K,y 0 )/8K to zero gives us the opti- 
mum K as 


K q = P x /y(Y 0 ) • • (4.3-15) 

Finally, we have the maximum optimized SNR, Q q = Q(K q ,y o ) , 
expressable as 


where 


- 


p x p w 


P p - U 2 (y ) 
X w H v ' o' 


(4.3-16) 


L m 


y(Y Q ) = / cos(2TrfY 0 )G (f)df 


(4.3-17) 


-f. 


m 


We observe that the relationship given in Eq. (4.3-14) 
is .satisfied when y q = 0. This corresponds to the expres- 
sion for Q shown above. Since Q_ is to be a maximum value, 
Oj o 

the denominator should be minimized. This is achieved by 
picking the maximum of y 2 (y q ) / which occurs at y q = 0* To 
further support this last claim, we introduce a result which 
is derived later in this chapter. When w (t) is given as a 
linear function of the PCM samples of x(t)', the cross-power 
spectral density, G xw (f) , is proportional -to the input power 
spectral density. Since G x (f) is bandlimited to f m , so is 


G xw ^ 


Because G VTT (f) is real and .even., we can use a slightly 

Xvv 


modified definition for the cross-correlation function [30], 


R xw (T) 


CO 

= / cos (2irf x) G^ (f ) df , 

— CO 


(4.3-18) 
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together with the fact that G^Cf) is bandlimited to f m , to 
show that - 

»<Y 0 > - R xw<V • (4.3-19) 

A simple property of this correlation function [31] is. 

ISjwWl <. 850 ,( 0 ) . (4.3-20) 

Consequently, y Q = 0 yields the maximum value of u(y Q ) and 
the maximum value of Q . We can now rewrite Eq. (4.3-16) as 


where 



P P 


P P - P 
X w xw 


xw 


f m 
= / 
” f m 


xw 


(f ) df 


(4.3-21) 


(4.3-22) 


Let us view the choice of y Q from a practical viewpoint. 
Since we have defined w(t) as a linear piecewise signal 
formed by connecting the PCM samples of x(t), we really have 
not shifted w(t) with respect -to x(t). If we recall, y Q is 
' the delay introduced in w(t) to optimize the SNR. But since 
w ( t) has not been shifted at all, we naturally expect y Q to 
be zero. In App. 4, we further pursue the dependence of Q q 
on y 0 by working through an example where we obtain a- plot 
of Q q as a function of y Q normalized by the Nyquist period. 
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4.3.3 SNR Statistical Analysis 

To determine the SNR of our. converter, we must first 
calculate the autocorrelation function of w(t) and the cross- 
correlation function of x(t) and w(t).. To accomplish this 
we set up a coordinate system depicted in Fig. 4.3-2 and ob- 
serve that the piecewise linear curve, w(t), .is actually the 
sum of a sequence of ramps of slope -m^ and the steps of am- 
plitude w^. To keep the time axis" completely' arbitrary, we 
introduce a random starting time for the ramp functions , 
shown as -t q . Independent of this, we are insured that w(t) 
is a stationary random process, as long as x(t) is specified 
as being stationary, since it is obtained via a linear trans- 
formation on x(t). We introduce, in Fig. 4.3-2, a random 
variable., X, which Is uniformly distributed in the interval 
0 to T^. To completely define this coordinate system, we 
must specify the parameters: 

i = Tx/T^l = the greatest integer <_ t/T n . ,(4.3-23) 

T = jT N + n Q / (4.3-24) 

' and 

n = T - iT N + X = n Q + If for o £ X £ T n . (4.3-25) 

Notice- that n Q is just a positive constant in the interval 
[0, T^) , which -is specified by the choice of x, and n is a 
random variable "obtained via a linear transformation of X. 

We start by deriving the autocorrelation function of 
w(t). To facilitate matters, let us express the ramps at 




Fig. 4.3-2. Coordinate System for Converter SNR Analysis 
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times and t 2 as 


and 


3(V> “ m Q 


z(t 2 = ti + T) = m^T) 


, T1 < T 


= m i+1 (n - T N ) , n > T 


(4.3-267“ 


(4.3-27) 


The slope of the ramps can be expressed as 


m i = (w i+l ' w i )/T S 


(4.3-28) 


and the amplitude of the steps, w^ , • is merely the sample 
values of x(t), i.e.. 


w i = x i 


(4.3-29) 


By faking the expectation over both the ensemble of the ran- 
dom process z(t) and the random variable X, we can find- the 
•autocorrelation function of the ramps, that is 

E[z(t 1 )z(t 2 )] = (l/2T N )n o (T N - Ti Q ) 2 R ln (i) 


+ (1/3t n ) (t n n Q ) ^(i) 


(4.3-30) 


+ (i/2T N )(n 0 - T N )[T 2 - <t n - n 0 ) 2 ]R m (i + l) 


+ (1/3T N )[T* - (T M - n 0 ) 3 ]R m (i + 1) , 


R^(i) = E (m k m k+i ) 


(4.3-31) 


= C2R v (i) - R v (i + 1) - R x (i “ 1)]/T 2 


x 


where 
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and 


. R x (i) = E(x k x k+i ) = R x (iT N ) . (4.3-32) 


If we combine the ramps and the steps, then. we can rep- 
resent w(t) at times t x and t in the following way: 


w ( t ^ ) = w Q + m 0 A 


and 


w(t 2 ) = w ± + m i n 


, n < t. 


- W i+1 + ra i+i (1 ' - v ' 1 > T : 


(4.3-33) 


(4.3-34) 


Using the averaging technique described above and the re- 
sults found in Eq. (4.3-30),. we can evaluate the autocorrela- 
tion function of w(t), i.e.. 


R^t) = E[w(t 1 )w-(t 2 ) ] 


= U/T n ) (T h - T) 0 ) R W (i> 


+ <V 6 V (t n - V 2 < 2t n + V R m (i) 


+ <1/2T„) (t - n 0 ) 2 B(m oMi ) 


+ (1/2T n ) ( t 2 - n 2 > E (m i w 0 ) 


+ + D 


* aSSM® 1 


+ (ho/6T N ) n o )R m (i + 1) 
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+ (n o /2T N ) (2T^ - ri o )E(m 0 w i+1 ) 

> 

i 

+ (n Q /2T N )E (m i+1 W Q ) , .(4.3-35) 

where i 

Vi> = E(w k w k+i ) " V 11 

and 

E(mjW k ) = [R^k - j r D “ R x ^ k ~'j) V%' • 

Simplifying Eq. (4.3-35 ) , we arrive at a final form of the 
autocorrelation function of w(t), 

R w (t) = (n 3 /6T 3 )[3R x (i) + R x (i + 2)] 

+ C (T n - n Q ) 3 /6TpCR x (i -1) + '3R x (i + 1)] 

- (l/T*) Tn* R x (i) + (T N ' t 1 o ) 2 r x <1 + 1)] 

+ (2/3) [R (i) + R (i + 1)] , (4.3-38) 

’ where 

n 0 = x — iT N (4.3-39) 

and i is the greatest integer less than or equal to.x/T N . 

We can reformulate this final form of the autocorrela- 
tion function of w(t) such that it takes on a general struc- 
ture and is a function of x , that is, 


(4.3-36) 

(4.3-37) 
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V t) = A iT 3 /T* + B ± t 2 /Tn + C i T / T N + D i ' (4.3-40) 

where 1 

A±, Bj_, C ± , = real numbers which are a 

function -of -i,- and R„(i). 

A 

We see that R (t) is a -piecewise continuous function having 

A 

different values of the coefficients A^, B^, and for 
each interval of t, [iT^, (i + A P^- ot °f R w ( T )r 

which shall be shown later, reveals that it is a well be- 
haved autocorrelation function, being continuous, real and 
symmetric about t — 0 . 

Employing the notation for w(t x ) introduced in Eq. 
(4.3-33) , it becomes a less formidable task to calculate the 
cross-correlation function between x(t) and w(t). If w.e 
observe, from Fig. 4.3-2, that w q and w x can be expressed as 

w Q - x(t x - X) (4.3-41) 

and 

w 1 = x(t x - X + T n ) , (4.3-42) 


then it can readily be shown that. 


R^tT) - R wx (t) = ECw (t j ) X (tj + t)3 


wx 


(4.3-43) 


= (1- X/T n )R x (t + X) + (x/t n )r x (t + X - t n ) 


where the average in Eq. (4.3-43) is over the random variable 


X. This can further be reduced to 
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T N 

R^t) = (1/T n )/ (1 - X/T n )[R x (t + X) + R x (r - X) IdX . 

(4.3-44). 

Consequently, if the correlation function of x(t)_is 
specified, we can formulate the correlation function of d(t), 
as given in Eq. (4.3-4), and its power spectral density, 
from Eq. (4.3-6). We can continue to simplify our results 
and show that the power spectral density obtained from 
■R xw (t) is a function of the power spectral density of x(t) . 
Taking the Fourier transform of Eq. (4.3-44) and performing 

some mathematical- manipulations , we obtain, in- its simplest 

' . 

form, 

G^ff )' = G x (f)-[-sin{-irfT^),/ir£%] 2 = (A-.-3-45) - - 

To completely specify the power spectral density of d(t), we 

must -calculate G_(f) from the correlation function of w(t). 

w 

Since R^t) takes the polynomial form given in.Eq. (4.3-40), 
we can use a slightly modified version of a well known numer- 
ical technique for the evaluation of the Fourier transform 
to obtain an exact expression for G w (f) [32]. 

By taking the third derivative, with respect to t, of 
the polynomial form of R w (t), given in Eq. (4.3-40), we obtain 

R^' » (t) = 6A-/T 2 . (4.3-46) 

Recall that A^ takes on a different value for each interval 
of t, CiT N , (i + 1)T n ]. Thus, R^"(t) takes on a different 
constant value every seconds . Taking one more derivative 
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with respect to x , we see that 

" CO 

T*R* ' "(t) = 2 M. 6(x - iT N ) , (4.3-47) 

N W i~_CQ 1 “ 

where, owing to the symmetry of R (x) , 

■M 0 = 12A q , (4.3-48) 

and 

M ± = M_ i = 6 (A ± - A ± - 1 ) , for i = 1,2,3, ••• , (4. ,3-49) 

and ■ 

6(a) = Dirac’s delta function. 

If we take the Fourier transform of Eq. (4.3-47), we obtain 

■ 3[T=r;'" (t)] = T=tjo J )*G w ( U ) 


‘f M.e' j “ iTN 

i=-» 


(4.3-50) 


Reformulating this, we have 

CO 

G (f) = [M + 2 E M. cos (2irfiT N ) ]/T^(2irf ) 4 . (4.3-51) 


Now that we have derived expressions for G^ cw (f) and 
G w (f), we must still evaluate and P w to calculate the 

SNR. The unoptimized SNR is the expression for Q with K = 1 
and y = 0, that is, from Eq. (4.3-11), 


SNR C 


p x + p w 2P xw 


’ (4.3-52) 


The optimized SNR, Q q , is given in Eq. (4.3-21). Because 
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G^Cf) is bandlimited to f , we can easily evaluate via 

^•N 

P xw -=-R xw (0) = (2/T N )/ (1 - X/T N )R x (X)dX . -(4.3-53.) 

However, the calculation of P^.is not so straightforward be- 
cause G w (f) is not bandlimited and the value of G w (0). goes 
to infinity. Thus, we cannot integrate G w (f) from -f m to 
+f . Consequently, we must’ use - 

■ P w = V 0) ' p w ' (4.3-54) 


where the out-of-band power in w(t) is given as 



= 2/ 6 (f)df 
f m 


(4.3-55) 


and the- total power in w(t) , 1^(0) , is found from Eq. 
(4.3-38) by setting ri 0 and i to zero. If we employ -G w (f) , 
as given in Eq. (4.3-51) , then P w takes' the form 



V M + 
o o 


E i^iMf , 
1=1 


(4.3-56) 


where Vj_ is a weighting coefficient that is a function of 
0.5 tt - Si (i) and Si (a) is the sine integral, defined in 
Eq. (3.3-15). 

We shall demonstrate the results of this statistical 
analysis by evaluating the SNR for two examples. In the 
first example, the input signal has a white, bandlimited 
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power spectral density and in the second example the input 
power spectral density has a triangular shape. For the for- 
mer case, the sum in Eq. (4.3-56) is finite. For the latter 
case, we can truncate after only 5 terms because the series 
converges rapidly to zero. In the next part, where we in- 
troduce improvements on this basic PCM to ADM conversion 
system, the series does not converge so rapidly and we must - 
introduce an estimation procedure to evaluate P w to .avoid 
excessive laborious calculation. 

If we specify unity input power, the power spectral 
density of the white, -bandlimited process (E.g. 1) is given 
as 


G,„(f) « T n , f | <- f. 


lx 


m 


= 0 , l f l > f m ' 


-(4.3-57) 


and its correlation function is 

r 1 X (t) = sin(2Trf m T)/2frf m T . (4.3-58) 

For this example, the output SNR and the optimized SNR is 
calculated to be 


and 


SNR Q (E.g. 1) = 8.6 dB 


Q Q (E.g. 1) = 12.7 dB . 


When the input spectrum has a triangular shape and we again 
set the' input power to unity (E.g. 2) , the power spectral 
density takes the form 
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G 2x (f) - 2T n {1 - |£/fj), (f | £ f m 

'* 0 i f l 1 f m 


(4.3-59) 


For this process, the autocorrelation function is seen to be 


R 2x (t) = [sin(7rf m T)/irf m T] 2 . (.4.3-60)- 


The figures of merit for this example are evaluated as 


SNR (E.g. 2) = 14.2 dB 


and 


Q (E.g. 2) - 17.3 dB . 


Obviously,, this level SNR is not acceptable, even for the 
extreme case of" a white, bandlimited input power spectrum. 
Therefore, we must introduce a refinement of "this basic 
conversion technique to improve the performance and yield 
larger values of SNR. 


4.3.4 Converter Improvement via Wiener Linear Interpola- 
tion 

The performance of this converter can be improved with 
a parametric technique, by first estimating a PCM midpoint 
from adjacent PCM samples, that is, both past and future 
values, and then converting to ADM format. The structure of 
the improved converter is basically the same as before and 
is shown in Fig. 4.3-3. We form the difference between the 
midpoint estimate and the PCM sample at the beginning of the 
Nyquist interval, scale this value by 2/R and accumulate it 











146 

R/2 times during the first half of the PCM clock period. 

This forms the signal v(k) which i-s encoded by the ADM. 

Then -we formulate the difference between the PCM value at 
the end of the Nyquist interval and the midpoint estimate. 
This value is scaled by 2/R and accumulated R/2 time’s during 
the last half of the PCM clock period. This continues to 
produce the v(k) signal which is 'again ADM encoded into the 
sequence of bits, e x (k). This process will yield two equi- 
amplitude staircases of different slopes for v(k) during 
each PCM sampling period. 

A Wiener linear interpolation technique is employed to 
obtain the PCM midpoint estimate' since it minimizes the mean- 

square error [33!]. The midpoint estimate is formulated as a 
~ i 

linear combination of the adjacent PCM samples. The weight- 
ing coefficients in the linear combination are a function of 
the autocorrelation function of the input process. The im- 
provement is demonstrated by analyzing this converter when 
2 and then 4 adjacent PCM samples are used to estimate the 
midpoint. The resulting SNR is .evaluated for the two 
examples mentioned above, that is, two different input power 
spectral densities. To determine a bound on the performance 
of- this converter, we calculate the SNR limit by letting the 
estimated PCM midpoint actually become the true PCM sample. 

The basic theory of linear mean-square estimation is 
best presented using a general approach. Since we have as- 
sumed that x(t) is a stationary random process, then all 
samples of it will be random variables. We must estimate 
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the midpoint between two samples from these random variables. 

If we use 21 sample points, then the midpoint estimate can 

be formulated as a linear combination of these random vari- 
ables in the- following way: 


x p (Rk + R/2) = a _( I _ 1 jX(Fk - (I-l)R) + ... 

+ a_^x(Rk - R) + a Q x(Rk) (4.3-61) 

+ a-^x (Rk + R) + ... + a^.x(Rk + IR) . 

Using a shorthand notation, we can express the midpoint es- 
timate as 

I 

x = 2 a.x. . (4.3-62) 

p i=- (1-1) 1 1 


To find the values of a L we apply the orthogonality 
principle. This principle states that the error must be 
orthogonal to the random variables . In other words , 


E[ (x p - x p )Xj3 = 0 , 

for j ■= - (1-1) , . . . , -1/ 0 , 1, 


(4.3-63) 

I . 


After taking the expected value , we obtain 


I 

R„ ( j - 0.5) = S a.R„(j - i) , 

X i— (1-1) 


for j — — (I— 1), «*., —Ir 0, 1, i 


(4.3-64) 


which is merely a set of 21 equations with 21 unknowns. 

Thus , we see that the values of a^ depend on the autocorre- 
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lation function of the input process . 

Now we can investigate the PCM to ADM converter per- 
formance when the midpoint is estimated with 2 and 4 adjacent 
PCM samples./ this is, when 1 = 1 and 2, respectively. The 
statistical analysis deals with w (t) , which is a straight 
line approximation between PCM points and midpoint estimates. 

To facilitate the SNR analysis, we divide the time axis into 
intervals of width T^/2 and index them "as follows : 

h = 0 , 1, 2 , for t >_ 0 , 

; = -1, -2, -3, . . . for t < 0 . 

We can again represent w(t) as the sum of steps and ramps. 

However, the form of the step and the ramp will be different 

for n odd and even. But, they will .always be a function of 

the adjacent PCM samples due to the linear interpolation 

technique used to formulate the midpoint estimates . 

To determine R (x) , we can formulate wttj) and w(t 2 ) in 
w 

a manner similar to Eqs . (4.3-33) and (4.3-34), except w(t x ) 

now spans two intervals and w(t 2 ) spans three because the 
width of each interval is only T N /2 . Now we must calculate 
R w (x) for n odd and n even, since the value of t sets n ac- 
cording to 

n = f2x/T N l = the greatest integer <_ 2x/T N . (4.3-65) 

Also, the amount of computation that must be performed in- 
creases by several orders of magnitude and cannot be readily 
computerized because there is extensive algebraic manipulations. 
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When the midpoint is estimated by 2 adjacent PCM 
samples ,. the autocorrelation function takes the form 


r w (t) = C - 2 R x (n “ 2] + C 0 R x (n) 

+ C 2 R x (n - 2) + C 4 R x (n + 4) 

for n even , , and - 


(4 . 3-66a) 


^(t) = C_ 3 R x (n - 3) + C_ 1 R x (n - 1) 
+ C x R x (n + 1) + C 3 R x (n + 3) 


(4 . 3-66b) 


for n odd, where 

C . = a third order polynomial function 

3 ~ of n and a function of a. . 

o r 

For this converter, we use 

n Q = x - nT N /2 . (4.3-67) 

From the form of R w (x) given above, it can be expressed as 
a third order polynomial function of x and, therefore , .we 
can apply the technique discussed in Sec. 4.3.3 to calculate 
the power spectral density of w(t) and the in-band power, P w . 

The evaluation of the cross -correlation function is 
approached exactly as described in the previous section. 
Because w(t' x ) spans two intervals, the amount of computation- 
greatly increases in determining After several pages 

of calculations , the final form becomes 
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T N/2 

R^t) - (2/T )/ (2 - o I X/%) 

0 

* (R x (t + X) + R X < T " *)) dX 


+ (2/T n )/ a 2 (1 - X/T n ) . (4.3-68) 

T N/2 

• (R (t + X) + R (t - X))dX , 

X A 

where 


a x , a 2 = a function of a^. 

Taking the Fourier transform of Eq. (4.3-68), we again find 

that G„ T ( f ) is bandlimited to f so that we can calculate 
aw hi 

the. in-band cross-power via 


p xw = R xw<°> • (4.3-69) 

The figures of merit can now be evaluated, using Eq. 
(4.3-25) to determine SNR Q and Eq. (4.3-21) for Q q . For 
example 1, where the power spectral density is white and band 
limited, we obtain 


SNR Q (E.g. I) = 10.2 dB 

and 

Q 0 (E.g. 1) = 11.7 dB . 

When the input spectrum is triangular shaped, we find that 


SNR 0 (E.g. 2) = 15.5 dB 



ubpeodxicibility of w 
original page is poo® 
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and 


Q (E.g. 2) = 16.2 dB . 

° i 

The slight increase in performance over the basic converter 
without a midpoint estimate indicates that our interpolation 
of the midpoint is not nearly accurate enough. We shall con- 
sider one more case, that is, estimating the midpoint from 4 
adjacent PCM samples. Then we shall analyze the limiting, 
case, where the estimated midpoint actually becomes the true 
PCM sample. 

The statistical analysis , when the midpoint is esti- 
mated from 4 adjacent PCM points, takes the exact -structure 
as described previously. Thus, all we shall do is present 
an outline of the results. The autocorrelation function of 
w(t) takes the form: 


V T) 


4 

£ C 2 -R x (n + 2j) , for n even, 
j~“3 


(4 . 3-70a) 


and 

V T > 


4 

£ c 2 j-l R x ( n + 2 3 “ ' for n od<i ' 

j=-3 


(4.3-70b) 


where Cj is given after Egs . (4.3-66). 

The effect of employing more PCM samples to estimate the 
midpoint manifests itself in the dependence of R w (x) on the 
input autocorrelation function. The cross-correlation 
function is structured exactly as in Eq. (4.3-68) except 
that now A is integrated over 4 intervals , of width T N /4 , 
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in going from X = 0 to X = T N . Consequently, G^if) is again 
bandlimited to f m and we can use Eq. (4.3-69) to determine 
P^. As before, the in-band power, P w , is found by applying 
the technique discussed in Sec. 4.3.3. Through all this 
analysis, the important results are still the figures of - 
merit. For the white, bandlimited power spectral density 
we obtain • - 


and 


■ SNR 0 (E.g. 1) = 13.0 dB 
Q 0 (E.g. 1) = 14.3 dB . 


If the input spectrum is triangular shaped, the results are 
SNR Q (E.g. 2) = 17.8 dB- 

and 

Q Q (E.g. 2) = 18.2 dB . 

Although the performance of this converter will con- 
tinue to improve as more PCM samples are used to estimate 
the midpoint, we would like to know the maximum value of 
' the SNR. To determine the maximum SNR, we must consider the 
limiting case where the estimated midpoint actually becomes 
the true PCM sample. The statistical analysis for the limit- 
ing case has already been completed. When the estimated mid- 
point becomes the true PCM sample the entire structure of the 
converter reverts back - to the basic PCM to ADM converter ex- 
cept the PCM rate is now 2fjj. Therefore, the results are 
identical to those derived in Sec. 4.3.3, but we must replace 
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T N by T^/2. This must be. done everywhere , so the. meaning of 
R (n) now becomes 

R x (n) = R x (t = nT N /2) . (4.3-71) 

Returning to the expressions for G w (f) and R w (t) and 
changing T n to T^. /2 , it becomes simply an arithmetic task to 
calculate and P„.. The results for the white, bandlimited 
and the triangular shaped power spectral densities are as 
follows : 

SNR 0 (E.g. 1) = 21.1 dB 
_ Q 0 (E.g. 1) = 25.3 dB 

and 

SNR Q (E.g, 2} = 26.4 dB 
Q q (E. g. 2) = 29.3 dB . 

Now the SNR is beginning to reach moderate levels. However, 
it is only at the expense of very precise estimation of the 
PCM midpoint. In the next section, we consider further im- 
provement of this PCM to ADM converter and a simple estima- 
tion technique to calculate SNR. 

4.3.5 Performance of the Improved Converters 

A further refinement of this conversion technique is 
obtained by estimating two PCM values between adjacent PCM 
samples and employing all of these points to convert to ADM 
format. The two estimated PCM values are obtained, as be- 
fore, using the Wiener criterion. In this case, we have 
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three equiamplitude staircases during each PCM sampling in- 
terval. The SNR analysis can easily be extended to this sys- 
tem just as was done when only the midpoint was estimated. 
However/ the algebraic computation becomes much too exten- 
sive. To ascertain the performance that we achieve with- . 
this improved method/ we can evaluate the limiting. SNR for 
the two input power spectral densities cited above. 

If we wish to apply the original statistical analysis 
to the limiting case for 2, 3 or m estimated points between 
adjacent PCM samples, all -we must replace T N by T^/m, 
in all the results derived in Sec. 4.3.3. However, in cal- 
culating the output signal power, P , we begin to experience 
computational difficulties'. Since' P w was formulated as the 
difference between the total power apd.' the out-of-band power r~ 

P w , we must calculate P w from an infinite sum of terms via 
w o w o 

Eq. (4.3-56). When we estimate more PCM points and take the 
limiting case, P Wq requires .more and moire terms to yield ■ 
meaningful results. These terms are a function of the sine 
integral. The result now depends on the accuracy of the sine 
' integral tables .or computation. 

To circumvent this computational problem, we introduce 
a simple estimation technique to calculate SNR. We start 
with the expression for the optimized SNR, where the input 
power has been normalized to unity, i.e.. 


^o 



(4.3-72) 
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We note that all terms in the expression for Q q are just 

slightly less than unity, particularly for the limiting 

cases where we estimate 2 or more points between PCM samples. 

Consequently, the denominator of Eq. (4.3-72) becomes the 

dominant term. Since Q q can never be negative, the smallest 

value of P is 
w 

P w (min) « P^ • (4.3-73) 

> 

Therefore-, the upper limit on the out-of-band power of w(t) 
becomes 

P w (max) = R^O) - P* v . (4.3-74) 

Since the lower -.limit on P Wq is zero, we can express it as 

P w = aP w (max), 0 < a < 1 . (4.3-75) 

w o w o 

The objective of this estimation technique is to elimi- 
nate P so there is no need to calculate P w . We can then 
w o 

arrive at an expression for the SNR which is composed of 
terms that are easily evaluated. Using Eqs . (4.3-74) and 

(4.3-75) we can formulate the output in-band- power as 

P w - (1 - a>V<» + OP iw • (4.3-761 

We can now obtain the desired figures of merit without deter- 
mining P . Setting the input power to unity, we obtain the 
following expressions for the SNR, before and after optimi- 
zation. 
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and, 


SNR 0 


(1 a ) R w ( 0 ) + od?xw 

1 + . (1 ct)R w (0) + a p xw - SP^ 


(4.3-77) 


(X — ct ) R w ( 0 ) + aP 
(1 - a) (R w (0) - P^) 


(4.3-78) 


Fitting these expressions to the results obtained so far, we 
have found that a value of a = 0.5 yields a very good' ap- 
proximation . 

The performance of all PCM to ADM converters discussed 
so far, for the two input power spectral densities cited 
above, is summarized, in Table 4.3-1. Here we list SNR Q and 
q- -through the limiting case when three points, are estimated-^ 
between adjacent PCM samples. Applying the SNR estimation 
technique described above , we have extended the results- to 
seven estimated PCM- points . In Fig. 4.3-4, we plot SNR Q in 
dB versus the number of estimated PCM points , for the limit- 
ing case, for both E.g. 1 and E.g. 2. As expected, each fur- 
ther refinement yields a higher SNR than all other converters 
previously considered. The tradeoff is, of course, an in- 
crease in hardware complexity. 

To see the progressive change in converter performance , 
with each subsequent modification, we can examine the auto- 
correlation function of w (t) . In Figs. 4.3-5 and 4.3-6, we 
have plotted R^x) for E.g. 1 and E.g. 2, respectively, for... 
three different PCM to ADM converter structures . As we go 
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TABLE 4.3-1. Performance of Parametric PCM to ADM Converters . 
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Fig. 4.3-4. SNR of Improved PCM to ADM 
Converters for the Limiting Case 




Fig. 4.3t5. Correlation Function of w(t) when Input Power Spectrum is 
White and Bqndllmited 
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Fig. 4.3-6. Correlation Function of w(t) when Input Power Spectrum is Triangular 
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from the basic converter where no PCM points are estimated, 
to the system which estimates a midpoint from four adjacent 
PCM samples, to the limiting case for one estimate point, we 
observe that R^x) yields a better and- better approximation . 
for the input autocorrelation functions, defined in Eqs . 
(4.3-58) and (4.3-60), for these two examples. The closer 
the autocorrelation function of w(t) is to R^x), the nearer 
P w and P^ will be to P x . This, of course, gives us a 
higher and higher output SNR. Therefore, the shape of R w (x) 
acts as a very good indication of the performance of our PCM 
to ADM converter. 

•4.3.6 Simulation of the Fundamental Converter 

- The basic PCM. to ADM converter,- as shown in Fig. 4.3-1, 
was simulated using a PDP 8/L computer. The Song audio mode 
ADM algorithm was employed in this simulation and several 
different elementary input signals were used to test its 
operation. To evaluate the performance of this converter, 
we utilized an ADM decoder, which is merely the feedback 
circuit of the encoder, and simulated a fourth-order Butter- 
worth filter as the output LPF . A sinusoidal test tone was 
applied to the input and SNR was measured after the output 
LPF. The simulation system is given in Fig. 4.3-7. Note 
that the cutoff frequency of the LPF, f , sets the bandwidth 
of the system and, therefore, the PCM sampling rate used' at 
the input becomes 


(4.3-79) 
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Fig. 4.3-7. Simulation System for PCM to ADM Converter Performance 
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In all previous performance evaluations , we employed a 
test tone of frequency f and specified the LPF cutoff fre- 
quency to be 4f Q . This, however, is not sufficient to 

t 

accurately test the performance of this converter. In Fig. 
4.3-8, we show a low and a high test tone, at frequencies 
f Q and 3f Q/ respectively. Both inputs must be utilized to 
ascertain a true picture of the operation of this system. 

On the low and high tones , we have superimposed the PCM 
samples and -the straight line approximations between them 
which represent w{t) . To gain a further idea of the system 
performance with the low tone , we have calculated the SNR of 
v(k) for various values of R. Recall that v(k) is the- stair- 
case waveform between PCM- points and R, defined in Eq. 

(4.2-1), is actually the number of steps between PCM points. 

We display, in Fig. 4.3-9, SNR^., which is the SNR for 
v(k) , after final low pass filtering, - as a function of R. 

Since w(t) follows x(t) so well, and because SNR V is rela- 
tively high, we do not expect much degradation when ADM con- 
verting v(k). We expect this test tone to yield good per- 
formance curves, indicating that the PCM to ADM converter is 
a success without using any PCM estimate points between ad- 
jacent samples. However, for the high tone, we observe that 
w(t) is a poor approximation to x(t). It is so poor,- in fact, 
that without even calculating SNR V , we know that we must use, 
at least, an estimated midpoint to achieve acceptable per- 
formance. But, we cannot estimate a midpoint based on the 
theory presented previously because it employed probabalistic 




(a) Low Frequency Tone 



(b) High Frequency Tone . 

i ' 

Fig. 4.3-8. Test Tones for PCM to ADM Converter and Straight Line 
Approximations between PCM Points 
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parameters of the input signal. These are virtually meaning- 
less for a deterministic signal, like a sinusoidal input. In 
the next section, we shall present the quantitative results 
obtained from these simulations, and- then go on to introduce- 
a non-par ame trie technique to estimate points .which can 
easily be applied- to the sinusoidal inputs. 

4.3.7 ~ SNR Curves 

All techniques, assumptions and manipulations .used in 
Chs . 2 and 3 to determine output SNR, when a sinusoidal input 
is applied to a computer simulated system, will again be 
utilized with the basic PCM to ADM converter. Since the 
input PCM samples , for both the low and high tones , are peri- 
odic, v(k) is also periodic and so is the resulting ADM es- 
timate, v (k) . We must first determine the Fourier series of 
the estimate. Then we can LPF v(k) -by scaling the frequency 
components as described in Sec.' 2.8. Finally, we can calcu- 
late the output performance figure of' merit, SNR Q , from Eq. 
(2.8-12), using the output noise power truncated after the 
ninth harmonic. 

By shifting the input x(t) with respect to the sampling 
clock, we again generated different steady state estimate 
patterns for v(k) and, therefore, different values of SNR Q . 
Treating the output SNR as a random variable, we calculated 
its mean and variance for 32 different .starting points of the 
input sinusoid. In Fig. 4.3-10, we. display the performance 
curves for the basic PCM to ADM converter, i.e., with no 
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estimate points between PCM samples, when a low frequency 
tone is used as the input. The input sinusoid is of fre- 
quency f Q ; the LPF cutoff frequency 'is fixed at 4f Q ; and the 
Nyquist rate set at 8f . On this graph, we. show SNR Q versus.* - 
relative input signal power, over a range of 54 dB, when the 
parameter R = takes on values 4, 6 and 8. To have a 

basis of comparison, we give the SNR curves obtained from an 
ADM, operating at a rate f , when the input is a sinusoidal 
signal.- This represents the best performance, that can be 
achieved when an ADM is used in the- converter. All these 
plots are smooth curves drawn from the mean SNR Q and an 
average standard deviation of 1-2 dB. 'We observe, as expec- 
ted, that this converter works very well for a low frequency 
signal. 

When employing the high frequency tone as an input, i.e., 
frequency 3f , we maintained the same LPF cutoff frequency 
and the same PCM rate. Likewise, the input signal was varied 
over the same range, from an amplitude of 5 minimum step 
sizes at -6 dB to 1280 minimum step sizes at 42 dB. The out- 
put SNR is shown in Fig. 4.3-11 for the basic PCM to ADM con- 
verter and an ADM encoder. The common parameter used is 
R = 4 and 8. We have again plotted the average SNR Q , with 
a standard deviation of approximately 1-3 dB, to obtain smooth 
curves for both the converter and the encoder . 

For the low frequency tone, the performance is quite 
acceptable since it is within about 1 dB of the maximum SNR. 
However, we find the figure of merit down 4 and 8 dB, for 
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R = 4 and 8, respectively, from the best SNR obtainable. 

Consequently, the basic converter is not acceptable in its 

present form and we must at least add a midpoint PCM estimate 
to raise the performance to reasonable quality. In the next- 
section, we present a non -parametric estimation technique 
that will do just this. - - 

4. 4 Non-Parametric PCM-ADM Converter' 

The obvious advantage of, designing a non-parametric PCM 
to ADM converter is that the structure of the system is inde- 
pendent of the input signal. We do not have to know the 
probability statistics or the power spectrum of the input. 

In considering the design of a non-parametric converter, we 
still wish to maintain a simple structure that can be readily 
built with all-digital hardware. In addition, we must avoid 
both the "multipath" and the "endpoint" problems discussed 
in Sec. 4.1. 


4.4.1 PCM Estimation Technique 

Let us consider the structure of the converter discussed 
in Sec. 4.3. With the ADM encoder as part of the converter, 
we automatically eliminate the "multipath" and "endpoint" 
problems. Thus,- we must only deal with the derivation of 
v (k) , i.e., the input to the ADM, from the PCM samples, 
x(Rk). As a natural extension of the technique described in.. 
Sec. 4.3, we can calculate the ADM input values using a 
method similar to that used to estimate points between 
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adjacent PCM samples. Taking this to its limit, we can de- 
termine R-l estimate points every T^ seconds. 

Deriving the estimate points from the PCM samples can 
be viewed as a filtering operation to obtain each estimate. 

A non-recursive digital filter structure would yield a 
specific weighting for every estimate point. 'Certainly, 
filters are designed without knowledge of the input signal 
statistics or its power spectrum. It thus becomes a ques- 
tion of what non -parametric design technique is optimal to 
employ when calculating estimate points between PCM samples. 
In the next section, we shall describe the best weighting 
technique that requires knowledge of only the bandwidth of 
the system. 


4.4.2 Ideal LPF Impulse Response Weighting 

If we consider the PCM points to be impulses , then the 
optimum technique to recover the input signal would be to 
ideal LPF the impulses. Therefore, we can find the value of 
the signal at any point between PCM samples by a superposi- 
tion of the input impulses. This concept is one statement 
of the sampling theorem [34], that is, if x(t) is bandlimited 
‘to f c then it can be represented by the equation 


x (t ) = S x(kT N )h(t - kT N ) , (4.4-1) 

k=-°° 

where 


T N _ • 


(4.4-2) 
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The "interpolation function". 


h (t) 


sin2irf c t 
2irf c t 


(4.4-3) ' 


is the impulse response of an ideal rectangular filter. with 
transfer function 

H (f ) = % , 

- 0 , 

The terms x(kT N ) are the PCM sample values, previously de- 
noted as x (Rk) . To exactly calculate points between adjacent 
PCM samples will take an infinite number 'of samples, thus 
infinite time. 

I 

• The form of the estimator given in Eq. (4.4-1) is 
exactly the structure of a digital recursive filter. There- 
fore, the implementation is readily adaptable to digital 
hardware. However, there are practical considerations that 
must be addressed. We must truncate the sum in Eq. (4.4-1) 
to a finite number of terms and still maintain an accurate 
estimate of the signal value. If we eliminate some of the 
R-l estimate points- and use instead the staircase approxima- 
tion originally presented in Sec., 4.3, the complexity of the 
converter can be considerably reduced-. We wish to know how 
many estimate points can be omitted and still achieve accept- 
able performance. These practical -considerations are dealt - 
with by reverting back to the basic PCM to ADM converter that 
employs only one estimate point between PCM samples. 


f < f c ' 


f I > f. 


(4.4-4) 
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4.4.3 Converter with Midpoint- Estimate 

Let us first consider the truncation of the infinite sum 
given in Eq. (4.4-1). The most general solution to this 
problem is by application of the Landau-Pollak bandwidth- 
constraint theorem [35]. However, this essentially requires 
-that we consider the sampling function, h(t), to be negli- 
gible after a certain value of t.' The Landau-Pollak theorem 
gives the error that will result from a finite number of 
terms in the estimation equation. We have found, with vari- 
ous simulation signals, that if h(t) is neglected after its 
second zero, then the estimate obtained- with four adjacent 
PCM samples is within 10% of the true signal value. This 
will act as a "rule of thumb" for the accuracy of our esti- 
mate points since the use of more PCM -samples in the estima- 
tor does not significantly improve the performance of this 
converter . 

To determine the number of estimate -values that can be 
eliminated and replaced by a staircase waveform, we return 
to the PCM -to ADM converter with midpoint estimate. Using 
the ideal LPF weighting function with four adjacent PCM 
samples, we calculate the midpoint with the following equa- 
tion: 

x’ (Rk + R/2) = h(3T N /2)x(Rk - R) 

+ h(T N /2)x(Rk) 

+ h(-T N /2)x(Rk + R) 

+ h(-3T N /2)x(Rk + 2R) . 


(4.4-5) 
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To show the qualitative effect of such, a system, we have de- 
termined the midpoints needed in a typical high tone test 
signal using the above algorithm for x' (Rk + R/2) . By observ- 
ing the straight line approximation w (t) , superimposed on 
the test tone in Fig. 4.4-1, we see that this .represents a 
fairly good approximation to the input sinusoid. 

We shall see that the performance of this converter 
comes within about 1 dB of the optimum figure of merit curve. 
In Fig. 4.4-2, we show a block diagram of the PCM to ADM 
converter with midpoint estimates using four adjacent PCM 
points. The weighting coefficients are defined as 

h x = h(±3T N /2) = 2/3 tt (4.4-6) 

and 

h 2 = h(±%/2) = 2 /tt . (4.4-7) 

This system represents a simple, straightforward hardware 
realization. ' To improve the converter performance and come 
closer than 1 dB to the optimum SNR curve by estimating 2 or 
3 points between PCM samples, it would be necessary to in- 
crease the hardware of the system by about a factor of two.. 
An unrewarding tradeoff for less than 1 dB increase in output 
SNR. 

4.4.4 Simulation and Performance 

Using the PDP 8/L, the PCM to ADM converter depicted in. 
Fig. 4.4-2 was simulated and tested with elementary input 
signals to verify its operation. SimiJLar tp the technique 




Fig. 4.4-1. Straight Line Approximation betweien PCM Points and Non- Parametric 
PCM Midpoint Obtained from Four Adjacent PCM Samples 
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PCM Format 



Pig. 4.4-2. Non- Parametric PCM to ADM Converter with Midpoint Estimate 
using Four Adjacent PCM Samples 
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employed in Ch. 3, the coefficients h l and h 2 were approxi- 
mated by the nearest integral multiple of 1/16. The result- 
ing decrease in output SNR was insignificant to warrant more 
precision in realizing .the .scalars h. x and h 2 . To determine .. 
the performance of this device, we repeat the procedure em- 
ployed in Sec. 4.3 with the high frequency tone.' The simu- 
lation system is exactly as shown in Fig. 4.3-7. We calcu- 
late the Fourier series representation of the ADM estimate, 
v(k), and determine the output SNR after low pass filtering . 
v(k) and truncating the noise power. The SNR acts as a ran- 
dom variable dependent upon the starting point of the input 
sinusoid and we must calculate its mean and standard devia- 
tion. This is all done only for the high frequency tone 
since the basic PCM to ADM converter performed very well with 
the low frequency input. 

The performance curves given in Fig. 4.4-3 are smooth' 
plots of the average SNR Q , with a standard deviation of 
1-2 dB, over a relative input power range of 54. dB. The 
parameter R takes on values of 4 and 8 yielding a system 
that makes 2 or 4 steps between each PCM sample and its 
adjacent midpoints. The' graph in Fig. 4.4-3 represents an 
•extremely comprehensive view of the performance of- this con- 
verter. As before, we show the SNR 'of the PCM to ADM con- 
verter with zero estimate points, i.e., the basic converter. 

We have plotted the SNR when one estimate point, the midpoint, 
is non-parametrically evaluated using four adjacent PCM 
samples. Observe that there is an increase of 7 and 3 dB 
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Fig. 4.4-3. SNR of Non-Parametric PCM to ADM Converters with High Frequency Tone 
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over the basic converter when R = 8 and 4 , respectively . 

From the last two curves , we obtain a good feeling for the 
worth of the converter with midpoint -estimate. When three 
estimate points are derived from four- adjacent. PCM samples, 
there- is- -only an increase of 0.5 dB. Likewise, the- optimum 
.performance, when we MM encode samples at f , yields only a 
1 dB increase over the system given in Fig. 4.2—2. We cannot 
use two estimate points between PCM samples because we must- 
have an integral number of steps between the various PCM 
values. With the values of R utilized, this is impossible. 

We can conclude that the non-par ame trie PCM to ADM con- 
verter, with midpoint estimate, is a rather successful sys- 
tem. It represents a compromise between a minimum amount of 
very simple digital hardware and the maximum figure of merit. 
-Since there is so little improvement in performance by going 
to a converter which utilizes three estimate values between 
PCM points , we are quite content not to extend the complexity 
of this device. Furthermore, with present-day technology, 
this entire system could be constructed, using large-scale 
integration, on one integrated circuit chip. 



4.5 Other PCM- ADM Converters 

-Following the converter concept presented previously, 
whe.re a digital filter operates on the PCM samples to pro- 
.duce signal estimates, at a rate f s , which are then. ADM en- 
coded , we can introduce several other PCM to ADM converters . 
The essential difference is the technique that is employed 
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to derive the signal estimates, i.e., the digital filter. 

We shall consider digital filters which range from an ex- 
tremely simple estimator circuit to a submultiple sampling 
filter designed with a Z-transform approach. 

4.5.1 ' Digital' Zero-Order Hold Circuit 

Perhaps the simplest device that can be employed to es- 
timate values from the PCM samples is a- zero-order hold fil- 
ter. This technique is analogous to the concept used by 
D. Goodman and J. Flanagan [36] to convert from ADM to linear 
DM formats. A zero-order hold circuit will keep the same 
PCM value for R ADM periods every Nyquist interval. This 
PCM value is used as the input to an ADM and the encoder 
treats it like a step input. Thus, the ADM estimate ap- 
proaches the PCM level and then hovers about it for the re- 
mainder of the Nyquist interval. - 

We could, of course, simply use a D/A converter and a 
holding circuit to keep the input at the ADM constant for 
the entire Nyquist interval. However, we would like to em- 
' ploy a completely digital hold circuit. If we define the 
digital zero-order hold filter as a circuit which holds one 
value at its output for R periods when the held value is .the 
input during the first period’ and there is zero input for 
the second through R ^ 1 periods , then it has the following 
transfer function: 

R— 1 . 

G Q (z) = E z -1 , (4.5-1) 

i=0 
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where z“ ^ represents a delay of T s seconds. From, the block 
diagram- shown in Fig. 4.5-1, it is obvious that this circuit 
will produce the desired result. 

An alternate digital hold circuit would be a bank of 
flip-flops, all operating on the PCM clock, to store the PCM 
sample word and hold it at the output until a new PCM sample 
.was clocked into the flip-flops. This realization, although 
not giving rise to a more mathematical transfer function, as 
Eg. (4.5-1) , is the practical approach to the problem because 
of its hardware -simplicity. , Although we will not analyze 
this system -in depth, we shall make some pertinent comments 
about its operation. We can determine the exact effect that 
“the digital hold circuit will have on x(Rk) by evaluating 
G 0 (m) from Eg. (4.5-1) with 

z = exp(jojT s ) . (4.5-2) 

However, for the purposes of this discussion, we can simply 
recall that an analog holding circuit transfer function, 
given in Eg. (3. 3-29), represents a crude low pass filter. 

Viewing the operation of this converter in the freguency 
domain, we wish to eliminate the high freguency components 
found in the sampled x(t) signal and retain, undisturbed, 
the baseband spectrum. . But, we expect the performance of • 
this converter to be worse than the basic converter des- 
cribed in Sec. 4.3. The basic converter employed a filter 
which produced a straight line between PCM samples and used 
values on this line as the input to the ADM. This filter is 
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a first-order hold and acts as a better LPF than the zero- 
order hold circuit. The only real virtue of the zero-order 
hold converter is its utter simplicity. 

4.5.2 Submultiple Sampling Technique 

A more refined approach- to PCM to ADM conversion is -to 
actually consider the design of a digital LPF which extracts 
signal estimates at a rate f s from the PCM samples, which 
occurs at a rate fjj = f s /R. The digital filter that will 
perform this .function must operate in the submultiple samp- 
ling mode [37]. When a digital system operates- in the sub- 
multiple sampling mode it simply means that the system pro- 
duces outputs at a frequency which is an integral multiple 
of the input frequency. This is exactly the case that exists 
in this converter. To thoroughly describe the submultiple 
sampling technique, we shall introduce two possible system 
designs. 

The first system design uses the PCM samples as inputs 
to the filter with R-l zeros inserted between PCM samples. 
Since we shall explain this theory in a general fashion, 
omitting the particular characteristics of the LPC, let us 
start with the Z-transform of a digital LPF represented by 
H s (z) and the input and output of the filter specified by 
X i (z) and X Q (z) , respectively. Then, as we normally expect,- 

X Q (z) = H s {z)X i (z) , (4.5-3) 

where z - ^ now represents a delay of T N seconds. 
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If we want the output to occur R times in the Nyquist 
sampling period and the input to have R-l zeros between the 
PCM samples of X^(z) , then the output is expressed as 


where 


V Z) R ” H s (z) R X i (z) ’ 
H_{z)p = .H- (z) z = z 1/,R 

% = V* • 


(4.5-4) 


(4.5-5) 


H (z)- is referred to as the submultiple sampling Z-transform 
of the digital LPF , H g (z), and is realized exactly the same 
as the ordinary digital filter .except delay elements are re- 
duced by a factor R and scalars with the constant T R inclu- 
ded are attenuated by the factor R. This implies that the 
digital filter operates at a frequency- Rf^-i- -One out of every 
R cycles sets the input to a PCM sample and the rest are in- 
serted zero. The 'filter operates on these inputs to produce 
signal estimates which are used as the input to the ADM. 

The second system design employs the PCM samples as fil- 
ter inputs for R ADM periods every T R seconds. This is simi- 
• lar to the PCM samples being held for the Nyquist period. 

If we incorporate the digital zero-order hold circuit pre- 
sented above with the submultiple sampling mode digital LPF, 
then we shall have achieved the desired design system. The 
PCM-held filtered output is given by 

X Q jj(z)r = G 0 (z) R H s (z) R X i (z) , (4.5—6) 


where 
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R-l . 

G fz) p = £ z _:L / R . (4.5-7) 

° R i-0 

Again, the- filter outputs- are used as the' input to -the ADM 
to complete the conversion. 

The actual . characteristics of the digital- LPF and -the 
comparison of these two design techniques is left for future 
research. We expect that the performance will be directly 
proportional to the order of .the digital LPF , chosen. Inher- 
ently, it seems that the holding circuit should add an addi- 
tional low pass filtering effect." and thereby enhance the 
system operation. These' conjectures are left to be verified 
by a more thorough investigation. 

4.5.3 Recent Developments 

There is not a great deal of literature that deals with 
systems to perform PCM to DM conversion and the related dif- 
ficulties involved with such systems . Some very brief - 
articles employ a binary rate multiplier and digital filters 
in converting from PCM to linear DM [38] . These studies are 
geared toward extremely simple hardware for the purpose of 
inexpensive realization. However, they must employ a tre- 
mendously high bit rate for the linear DM, in the order of 
several megabits per second. 

Virtually nothing has been reported that seriously con- 
siders PCM to ADM conversion. There is no practical, sys- 
tems-oriented research nor do we find any detailed theoreti- 
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cal analysis. Therefore, this area is almost completely open 
for many new ideas and much further investigation. 
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• CHAPTER 5 
CONCLUSIONS 


In this final chapter, we summarize the contributions 
of this research work. We also present a brief comparison 
between the systems designed and other digital circuits, 
where practical, or optimal systems which perform the same 
function. In addition, we discuss new problems that can be 
addressed as natural extensions of this thesis. 

The work done on the topics considered in this thesis 
is viewed as a .success. We were able to solve the three 
problems introduced with simple, all-digital systems and 
achieve good performance with simple hardware. In Ch. 2, 
we have conclusively shown that arithmetic processing- can 
be performed on ADM encoded signals by operation. on the ADM 
bit streams. Thus, we do not have to resort to PCM or ana- 
log processors . We have demonstrated that the performance 
and hardware complexity of the direct ADM adder and multi- 
plier are comparable to those of equivalent PCM. devices. 

In Ch. 3, we have derived a theoretical design technique 
for constructing an ADM to PCM converter. We have also shown 
that, for moderate ADM bit rates, the SNR -of this system is 
within 1 dB. of the performance of the ideal analog demodula- 
tion converter. Neither of these two accomplishments is , 
however, the most important aspect of this work. The most 
significant contribution - is the thorough explanation of why 
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some sort of LPF is needed in converting from' ADM to PCM 
formats . 

The work on PCM to ADM conversion addresses a problem 
almost untouched in the literature and obtains, significant, 
practical results for the first, time. We refer particularly 
to the ’ftiultipath" problem and the various ways that it can 
be solved, i.e.: with probabalistic statistics of the input 

signal, or parametrically, -utilizing the input power spec- 
trum, or non-parame trie ally, using no information about the 
input signal except its bandwidth. The SNR obtained for the 
non-parame trie PCM to ADM converter, with one estimate PCM 
point obtained from four adjacent PCM samples, came within 
1 dB of the optimal PCM to ADM converter, in which samples . 
of the input signal are directly ADM encoded. 

From the basic results of these three chapters, we see 
that the overall purpose of this research was accomplished. 

We were able to design direct ADM arithmetic processors and 
to devise conversion systems between ADM and PCM formats with 
simple, all-digital circuits that yield good performance. 

This leads us to the additional ideas that were generated by 
this thesis and new work that can be done as an extension 
of it. 

Other than the few examples mentioned in Ch. 2, the use 
and applications of the ADM arithmetic processors still re- 
main to be explored. This is. also true for the conversion 
systems, particularly PCM to ADM since, ADM to. PCM conversion 
can generally be employed as an intermediate step in A/D con- 
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version. There are two new ideas that emerge from the study 
of direct arithmetic processing of ADM encoded signals. The 
first concept is the mapping of. the ADM bits, e x (k) an< ^ ®y(k), 
into a processed ADM bit, e r (k) . The- processed bit can have 
2, 3 or more values depending on 'the current and perhaps even 
on the past ADM input bits. This processed bit would then 
be employed in an algorithm, let us say, similar to that of 
a Song audio mode decoder to generate ah estimate of the sum 
or product of the two input signals. The mapping of e x (k) 
and e v (k) into e (k) as- well as perhaps the decoding algorithm 
for e r (k) will be different for addition and multiplication. 
The second idea, completely different from the first, is to 
convert the ADM encoded .signals to linear DM f ormats , operat- 
ing- at a higher rate. We can now use the very simple linear 
DM multiplier, designed to obtain the product, and then- con- 
vert back to ADM. The considerations in this approach are 
performance and the hardware complexity required to construct 
such a system. 

In Chs . 3 and 4, we have briefly mentioned several other- 
conversion techniques that require a follow-up study . In 
particular, the submultiple sampling filter approach to PCM 
to ADM conversion appears to, be a rather easy and straight- 
forward solution to this problem. We must consider the ef- 
fect of starting with a companded rather than a linear PCM 
format. We would like to investigate the variation in per- 
formance as a function of the order and type of filter em- 
ployed. We can employ different ways of measuring converter 
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performance. If we use white Gaussian noise, bandlimited 
from 500 to 1000 Hz, to represent a speech waveform, then we 
can encode this waveform in ADM or PCM and apply our conver- 
sion process . We can then measure output power in and out 
of the 500 Hz band to determine converter performance. This 
represents, a possible, significant improvement over the re- 
sults obtained with a single test tone. Likewise, we could 

generate voice tapes with systems that have been physically 

/- 1 

realized. 

This brings us to the last few thoughts that could be 
pursued as future work. For all three topics discussed, 
since the designs have been oriented toward digital hardware 
we would like to construct real time versions of the proces- 
sors and converters'. Then, we can truly -test voice signals 
with subjective evaluation and even extend all the work to 
the Song video mode ADM and observe the effect on picture 
quality. An experimental study of this type will bring out 
additional practical aspects of the work accomplished here, 
some of which may not appear otherwise. 
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APPENDIX 1 

AMPLITUDE-FREQUENCY CHARACTERISTICS OF THE 
FOUR-TERM NON-RECURSIVE AVERAGING FILTER 


In this appendix, we derive the expression for |H a (w) j , 
i.e., Eq. (2.3-9), from the digital transfer function, 

_H a (z) = (1 + z“^ + z“ 2 + z“ 3 )/4 . (Al-1) 

If .we set 

z = exp(jwT ) (Al-2) 

is 

and separate terms,- we obtain 

H (u) = (1 + e “^ uT s)/4 + e *'j2(oT s (1 + e -joT S )/ 4 . (Al-3) 

cl 

Factoring Eq. (Al-3) , it reduces to 

H.(io) = (1 + e"^wT s) (1 + e -j2wT s)/4 # (Al-4) 

ci 

By removing e _3U)T s/ 2 from the first term of this product and 
e _ juT s f rom second- term, we reveal a rather familiar form 

H (to) = e “^ wT s/ 2 [ ( e ^ uT s/ 2 + e"^“ T s/ 2 )/2] (Al-5) 

cL 

(Al-5) 

. e ”^ wT s[ ( e ^ uT s + e'^ T s)/2] . 

Recognizing the exponential definition of the cosine, we can 


now write 
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H a (w) = e ^ 3wT s/ 2 cos (coT s /2)cos (coT s ) . (Al-6) 

Thus, by observation, we see that the amplitude-frequency 
characteristics of the four-term non-recursive averaging fil- 
ter are given by 

| H a <o>) | = | cos (wT s /2) cos (wT s ) j . (Al-7) 
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APPENDIX 2 

THE PCM PRODUCT VIA ALTERNATE TECHNIQUES 

There are many other techniques to obtain the PCM 
product of x(t) and y(t) by using the 'samples of both sig- 
nals at a rate 2f . Some- of these shall be discussed in 

m 

this appendix. It is clear. that we can low pass filter the 
samples of each signal, return to the analog domain, perform 
an analog multiplication and then resample at 4f m . This 
will certainly give us PCM samples of the product. However, 
we must resort to a complete analog multiplication. This 
'.can be avoided by holding the samples of each signal for 
l/2f m seconds and multiplying the held values. If we as- 
sume that the samples are actually quantized values, then 
we have a multiplication of discrete values yielding a dis- 
crete product — just like digital multiplication. The only 
difference is that the product is a held waveform rather 
than being, samples. To obtain the PCM product, we must re- 
' sample the held product at 4f m and A/D convert. 

We shall show first that the holding and multiplying 
technique- described above does, in fact, produce the product 
of x (t) and y(t) and second that it is not a good technique 
to employ because of the distortion that it introduces into 
the product. It is intuitively apparent that this technique 
will yield the product because, by holding the. samples of 
each signal, we are low pass filtering them. The transfer 
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function of the holding circuit for a signal bandlimited to 
f m and sampled at the Nyquist frequency is given as [39] 


G h (co) 


sin ( uT n /2) 

coTjj/2 


(A2-1) 


where 

T n = l/2f m = the Nyquist period. _ (A2-2) 

Although the holding circuit has LPF characteristics , they 
are not very flat in-band and do not cutoff sharply. This 
causes distortion of the in-band signal spectrum and does 
not completely eliminate the out-of-band spectrum. 

To demonstrate this concept, we define the Fourier ' 
transform of x(t) and y (t) as . ' 


X(w) = S^CxCt)] (A2-3) 

and, 

Y (wj = 3[y(t)] . (A2-4) 

The sampled spectra of x(t) and y(t) are given as 


X* (w) = £ X (to + nw N ) (A2-5) 

n=-<» 

and 

CO 

Y*(w) = E Y (w + nfa)^) (A2-6) 

n =-eo 

where 

w N = 2irf N (A2-7) 

and 

f N = 1 /T n = the Nyquist frequency. (A2-8) 
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After holding, X* (co) and Y*(u) are multiplied by G H (u) which 
greatly attenuates, but does not completely eliminate, the - 
out-of-band spectra. If we multiply the held- signals. in the 
time domain, we must convolve their frequency domain spectra. 
Denoting this product spectrum as Z(co), it is expressable as 


CO 

Z (w) ~.j G h (v)X* <v)G h (w - v)Y*(w - v)'dv . (A2-9) 

— CO 


To show that the actual product spectrum is imbedded in 
Z(w), we must decompose X* (w) and Y* (to) into its in-band and 
out-of-band spectra, i.e.. 


X*(w) = X(w) + X Q (w) 

where 

CO 

X (w) a 2 [X{w + nto N ) + X(w - nco N ) 3 
w n=l 

and 

Y* (w) = Y(co) + Y q (w) 

where 

CO 

Y (w) = 2 [Y{w + nio N ) + Y (co. - nu^}-] . 

° . n=l 

Now we can recast Z(m) in the following form: 


(A2-10) 


(A2-11) 


(A2-12) 


(A2-13) 


Z(w) + / G h (v)G h (w - v) X (v) Y (to - v)dv + 2 dl (to) , (A2-14) 


where 


Z dl (to) = / G h (v)G h (03 - v)[X(v)Y o ( 0 > - V) 


H ' v * 


+ X Q (v) Y^ (w - v) ]dv 


(A2-15) 
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and this term, Z dl {w), represents distortion. 

With the aid of some trigonometric identities', we can 
expand G H (v)G H (w - v) into the following form: 


G H ( W G H^“ - v) 


sin (wT N /2) sin (vT N /2) cos (v%/2) 


(wv - v 2 )T^/4 


cos ( wT n / 2) sin 2 (vT w /2) 
(tov - V z )T§/4 


(A2-16 ) 


Letting the second- term of Eq. (A2-16) also contribute to 
distortion, we rewrite Z(w) as 


»fM> = sin (coTjj/2) J ^W%I xMy(( , . , )a< 

Tft/ 4 


00 03 V " V 2 


m / “j 


(A2-17) 


+ Z a2 ( U ) + z al (oi) . 


where 


. -cos(o)T n /2) ” sin (vT N /2) ... . , 

Zj) 9 (oj ) * — — / X(v)Y(ft) - v) dv . 

T]|/4 -°° (DV - V 2 


(A2-18) 


By expanding sin(vT N ) into its power series, 

sin(vT N ) = vT n - (vT n ) 3 /3! + (vT n ) 5 /5! - + ••• ,(A2-19) 

canceling the common factor (v) from the denominator (wv - v 
and then writing the power series for 1/ (w - v) as 



(1/0)) [1/(1 - v/fri] = (1/tri) [1 + V/tri + (v/tri) 2 + **•] , 

(A2-20) 

we can express sin (vT N ) / (wv - v 2 ) as 


siri (vT N ) / (wv - v 2 ) =s (T N /to) [1 + v/oj + (v/w} 2 + * * • ] 

- (T^/tri3!)[v 2 + v 3 /to + vVw + •••] + - ••• • 

(A2-21) 

If we allow all terms but T N /tri in Eq. (A2-21) to contribute 
to distortion, then we can write Z(w) as : 


Z(tri) = 4 s in(t o_ %/2) _ °j x(v)Y(u _ v)dv + z d3 (tri) 
triT N /2 -oo 


+ ^d2‘^ U ^ + ^dl^ W ^ ' 


(A2-22) 


where 


z a3 (o)> 


_ sin (tri 


w %/2 


t n/ 2 ^ J 


sin ( vT n ) _ % 
wv - v 2 01 


X (v) Y (tri - v) dv . 

(A2-23) 


We recognize the spectrum of the product in Eq. (A2-22) 
as the convolution of X(w) and Y (to) . However, we observe 
that it is shaped by sin (triT^/2) / (mT^/2) and there are the 
additive distortion terms, (w) , z d 2 ^ an< ^ Z d3 ^ ' T ^ us ' 
although we have shown that the actual product is embedded 
in .Z (tri), we have also shown that we do not expect the product 
to be of very high quality because of all the distortion con- 
tained in Z (w) . 
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FREQUENCY CHARACTERISTICS OF THE CASCADE ARRANGEMENT 
. FILTER, H r n ( z ) , USED IN ADM TO PCM CONVERSION 

In this appendix, we present a derivation of the trans- 
fer function, H CD (f), given in Eq. (3.3-26), which shows the 
effect of the non-recursive. filter (Fig. 3.3-2) on the ADM 
estimate, x(k). .The filter coefficients, g(i), are obtained 
from the step response of an ILPF (Fig. 3.3-5). We have set 
Q, the number of filter coefficients, to be. an even integer 
and specified g(0) =0. The remaining Q-l coefficients are 
symmetrically distributed about 0.5 on the g(t) curve. Due 
to the symmetry of g(t), this implies -that •_ • s 

g(Q/2) ~ 0.5 , (A3-1) 

g (i ) = 0.5 - g' (i) , for i =* 1, 2, • • •', Q/2 - l,(A3-2) 


and 

g (i) = 0.5 + g' (Q - i) , for i = Q/2 + 1, Q/2 + 2, 

• • • , Q - 1 . (A3-3) 

To find the frequency characteristics of H^(z) , where 

„ i Q " 1 

H rn (z) = z~ Q + (1 - z - 1 ) 2 g(i)z 1 , (A3-4 ) 

i=0 


we first evaluate the frequency spectrum of 
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Q-l 

H (z) = £ g(i)z . . (A3-5) 

° ±=0 

-q/2 ’ ' 

Factoring out z and noting that g(0) =0, Eq. (A3-5) be- 

comes 

\ * 

H (z) = z" Q / 2 £ g(i)z Q / 2_i (A3-6) 

° i=l 

If we substitute Eqs . (A3-1-) , (A3-2) arid (A3-3) in the above 

expression for H Q (z) and gather terms from the sum, in pairs 
of two, by mating the terms (i = 1, i = Q - 1) , (i = 2 , 
i = Q - 2) , •••., we shall produce Q/2 - 1 pairs of the form 

0.5 [ z Q/2 - m + z -(Q/2 - m)] _ g . (m)[z Q/2 - m _ z -'(Q/2 - m) ] ; 
where 


m = 1, 2 , • • • , Q/2 - 1 , 

and one term, when i = Q/2, yielding g(Q/2)z° = 0.5. 

By letting 

z = exp(jwT s ) , (A3-7) 

we see that each pair gives rise to a cosine and a sine term 
of the form 

cos (w (Q/2 - m)T s ) - 2jg' (m) sin (‘w (Q/2 - m)T s ) . 

If we now set 


m = Q/2 - i 


/ 


(A3-8) 
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Siam all pairs , and include the term when i = Q/2 , we obtain 
H 0 (m) = e"^ QwT s/ 2 [C(w) + jS (to) 1 , (A3-9 ) " 

where 


Q/2-1 

E 

i=l 


C(w) = 0.5 + E cos (iti)T s ) 


(A3-10) 


and 


Q/2-1 

S(w) = -2 E g' (Q/2 - i)sin(iwT s ) . (A3-11) 

i=l 


-(Q+D/2 

Returning to Eq. (A3-4) and factoring out z , we 


see that 


H CD U) - z - (Q+1)/2 [z- (CKL,/2 ♦ (z 1/2 - z- 1 / 2 )^/ 2 H o (z>] . 


(A3-12) 


Again letting 


z = exp ( jwT ) , 


(A3-13) 


the above expression becomes 


h cd 


(u) -= 


-j (Q+l)wT s /2 r -j(Q-l)wT s /2 
e te 


(A3-14) 


+ 2jsin (toT s /2) [C (w) + jS(to)]} . 

If we apply Euler's formula to wT s/ 2 and expand Eq. 

(A3-14 ) , we find that 
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H cd (o 3) = e“ j(Q+1)wT s /2 {[cos(a)T s (Q - l)/2) 

- 2sin (wT s /2).S (co) 

(A3-15) 

+ jC-sin (o)T s (Q - l)/2) 

+ 2sin (ojT _/ 2) C (u) 3 } . 

D - f 

Now we combine the following equations 

to = 2iTf / (A3-16) 

f s = VT S = (A3-17) 

and 

f N = 2f c , (A3-X8) 

. to see that 

wT = irf/Rf . ' (A3-19) 

SC , 

By substituting Eq. (A3-19) and the formulae for C(w) and 
S (m) / given in Eqs . (A3-10) and (A3-11) , respectively, into 

Eq. (A3-15) , we arrive at the final form of H CD (f)/ i.e.. 


H CD (f) = exp(-j(Q + l)rf/2Rf c )({coB( T (Q - 1) f/2Rf c ) 


Q/2-1 

+ 4sin(Trf/2Rf c ) C 2 g’ (Q/2 - i) sin (iirf/Rf c ) 3 } 


+ j {-sin (it (Q — 1) f/2Rf c ) + 2sin(irf/2Rf c ) 



202 


Q/2-1 

• [0.5 + E cos(iirf/Rf )]}) . 
i=l ' C 

(A3-20 ) 
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■ appendix 4 

THE EFFECT OF TIME DELAY ON THE SNR OF THE 
BASIC PCM TO ADM CONVERTER 

Although we have shown that the time delay, y Q , required 
to maximize the optimum SNR of the basic PCM to ADM converter 
is zero, it is interesting to study the relationship between 
Q q and the time delay, y Q . We shall explore this dependence 
for the case of a white , bandlimited input power spectral 
density, that is, 

G x (f) = T n , |f | < f m , 

(A4-1) 

• =0 , | f | > f ra / 

where 

T m = l/2f . (A4-2) 

N m 

This input power spectrum is one of the examples applied to 
the SNR statistical analysis. 

' Since the iriput power is set to unity, as seen from Eq. 
(A4-1) , we shall begin from the expression for Q q given in 
Eq. (4.3-16), with P x = 1, i.e. , 

Q = * . (A4-3) 

° i-y 2 (Y 0 )/P w 

The in-band signal power is calculated from 

p w = V°> - p w 0 


t 


(A4-4) 
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where 


1^(0) = the total power in w(t),' which is 

evaluated from Eq. (4.3-38) for this 
particular example. 


and 


P w = the out-of-band power in w(t), found 
° from Eq. (4. 3.-56). . . 


For the basic PCM to ADM converter, and this example, these 
calculations are easily made since Eq. (4.3-56) becomes a 
short, finite -sum. 

We must evaluate y (y ) to see the effect of y Q on the . 
SNR. Starting with Eqs . (4.3-17) and (4.3-45), and the even 
property of G^ff), we can express y (y 0 ) by the following 
integral , 


U(Yq) 


_. , . /m , ^ m r cos (2irfy 0 ) 

Lxm (4/T N ) / C — 

e-K) - e (2irf ) 2 


cos (27rf (y 0 + T N ) ) + cos(27rf(Y 0 ~ 
2 (2Trf ) 2 


(A4-5) 

where we have employed some trigonometric identities and used 
the limit as e -> 0 because the integrand blows up at f = 0 . 
After changing variables and using a well-known relationship 
from a table of integrals , 


/225*dx 

; X 11 


cosx 

(n-l)x n_1 


i.,.;gl5*ax , n > i 

(n-l) x 11 " 1 


(A4-6 ) 


we can, with the aid of L’ Hospital *-s rule, calculate all 
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terms in Eq. (A4-5) . 

The final expression for u(Y 0 ) takes the following form: 

U(Y 0 ) = -(4/tt 2 )cos (7TY 0 /T n ) 

- (2/tt) (Yq/Tn 5 Si (7T Y 0 /T n ) 

+ Cl/ir) (1 + y 0 /T N )Si(7r(l + Y 0 A N > ) 

-+ (1/tt) (1 - YqA n ) Si (it d - Y 0 /%) ) 

(A4-7) 

where 

a , 

Si (a) = (A4-8) 

0 x 

and the sine integral. Si (a) , is a common tabulated function. 
Now we can evaluate Q q from Eq. (A4-3) for various^ values of 
'y q /T n . In Fig. A4-1, we show a plot of Q q versus Y Q /T N for 
| y 0 I 1 t N* When [y q | > T N , Q q will oscillate between 0 and 
1.5 dB. We observe that the peak occurs at y q = 0 as expec- 
ted and after y q = ±0.2T N the Q q curve falls off very rapidly. 
This indicates that we can have a delay of several ADM peri- 
ods before we suffer a drastic reduction in SNR, but no more 
than one-fifth of the Nyquist period. 
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